-- Logs begin at Sun 2022-08-28 09:35:57 UTC, end at Sun 2022-08-28 10:42:10 UTC. -- Aug 28 10:05:24.480934 dv-cinder-852009-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 28 10:05:24.489471 dv-cinder-852009-4-smb devstack@keystone.service[81585]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 10:05:24 2022] *** Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: nodename: dv-cinder-852009-4-smb Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: machine: x86_64 Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: clock source: unix Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: pcre jit disabled Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: detected number of CPU cores: 4 Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: current working directory: / Aug 28 10:05:24.491460 dv-cinder-852009-4-smb devstack@keystone.service[81585]: detected binary path: /usr/bin/uwsgi-core Aug 28 10:05:24.492136 dv-cinder-852009-4-smb devstack@keystone.service[81585]: your processes number limit is 47680 Aug 28 10:05:24.492136 dv-cinder-852009-4-smb devstack@keystone.service[81585]: your memory page size is 4096 bytes Aug 28 10:05:24.492136 dv-cinder-852009-4-smb devstack@keystone.service[81585]: detected max file descriptor number: 2048 Aug 28 10:05:24.492136 dv-cinder-852009-4-smb devstack@keystone.service[81585]: lock engine: pthread robust mutexes Aug 28 10:05:24.492136 dv-cinder-852009-4-smb devstack@keystone.service[81585]: thunder lock: enabled Aug 28 10:05:24.492136 dv-cinder-852009-4-smb devstack@keystone.service[81585]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 28 10:05:24.492136 dv-cinder-852009-4-smb devstack@keystone.service[81585]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 10:05:24.531408 dv-cinder-852009-4-smb devstack@keystone.service[81585]: Python main interpreter initialized at 0x5597872ec9c0 Aug 28 10:05:24.531408 dv-cinder-852009-4-smb devstack@keystone.service[81585]: python threads support enabled Aug 28 10:05:24.531408 dv-cinder-852009-4-smb devstack@keystone.service[81585]: your server socket listen backlog is limited to 100 connections Aug 28 10:05:24.531408 dv-cinder-852009-4-smb devstack@keystone.service[81585]: your mercy for graceful operations on workers is 90 seconds Aug 28 10:05:24.531762 dv-cinder-852009-4-smb devstack@keystone.service[81585]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 10:05:24.531839 dv-cinder-852009-4-smb devstack@keystone.service[81585]: *** Operational MODE: preforking *** Aug 28 10:05:24.532095 dv-cinder-852009-4-smb devstack@keystone.service[81585]: *** uWSGI is running in multiple interpreter mode *** Aug 28 10:05:24.532095 dv-cinder-852009-4-smb devstack@keystone.service[81585]: spawned uWSGI master process (pid: 81585) Aug 28 10:05:24.532320 dv-cinder-852009-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 28 10:05:24.533711 dv-cinder-852009-4-smb devstack@keystone.service[81585]: spawned uWSGI worker 1 (pid: 81596, cores: 1) Aug 28 10:05:24.533820 dv-cinder-852009-4-smb devstack@keystone.service[81585]: spawned uWSGI worker 2 (pid: 81597, cores: 1) Aug 28 10:05:24.533969 dv-cinder-852009-4-smb devstack@keystone.service[81585]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 10:05:28.875834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:05:28.875834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: from cryptography.utils import int_from_bytes Aug 28 10:05:28.876615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:05:28.876615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: from cryptography.utils import int_from_bytes Aug 28 10:05:28.879389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:05:28.879389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: from cryptography.utils import int_from_bytes Aug 28 10:05:28.879866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 10:05:28.879866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: from cryptography.utils import int_from_bytes Aug 28 10:05:28.929501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 10:05:28.929691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 10:05:28.929897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] command line args: [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 10:05:28.930136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 10:05:28.930236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 10:05:28.930316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 10:05:28.930393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ================================================================================ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 10:05:28.930510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] command line args: [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 10:05:28.930598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] admin_token = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.930789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 10:05:28.930875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_dir = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.930953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ================================================================================ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 10:05:28.931030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.931172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] config_source = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.931261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] admin_token = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.931341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] debug = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.931418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_dir = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.931544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.931849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.931849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] config_source = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] debug = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.932933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_config_append = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_dir = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_config_append = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.933974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.934074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_dir = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.934074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.934850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.934941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.935945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.936963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.937051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.937210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.937340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.937462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.937541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.937710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.937956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938038 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] publish_errors = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] publish_errors = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.938995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.939161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.939239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.939310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.939457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] standard_threads = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.939537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.939691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.939771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.939923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940100 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] standard_threads = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_journal = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940405 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_json = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_stderr = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] use_syslog = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.940971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_journal = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.941040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.941142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_json = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.941283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.941362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_stderr = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.941495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] use_syslog = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.941579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.941727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 10:05:28.941817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.941997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.942151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.942233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.942310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.942477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.942555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.942727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.942813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.942966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943760 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.943991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.944161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.944250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.944419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.944505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.944662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.944742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.944908 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.944996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.945140 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.945219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.945384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.945469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.945629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.945716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.945867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.945946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.946100 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.946184 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.946355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.946445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.946597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.946681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.946830 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.946907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.947993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.948070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.948240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.948349 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.948502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.948592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.948733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.948816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.948966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.949044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.949213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.949293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.949438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.949514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.949669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.949819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.949997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.950143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.950395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.950471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.950764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.950840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.951955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.952033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.952189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.952360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.952450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.952530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.952668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.952781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.952906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.953917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954619 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.954994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.955077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.955230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.955319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.955462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.955547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.955694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.955778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.955930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.956017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.956158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.956237 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.956412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.959996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.960938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961367 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.961932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962832 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.962975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.963984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.964995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.965150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.965240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.965409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.965492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.965674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.965828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.965910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.966146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.966226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.966390 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.966468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.966634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.966711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.966866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.external = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.966954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.967098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.967208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.967373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.967454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.967613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.967691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.967843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.external = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.967923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.password = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.968072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] auth.token = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.968150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.968343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.968469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.968570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.968650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.968821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.968913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.password = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] auth.token = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.969993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.970087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.970237 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.970324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.970483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.970574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.970730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.970809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.970974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.971053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.971220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.971308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.971457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.971536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.971703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.971782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.971945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.972031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.972183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.972270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.972444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.972535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.972693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.972781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.972947 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.973027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.973184 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.973264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.973437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.973588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.973692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.973772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.973931 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974272 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.974996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.975146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.975232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.975383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.975462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.975640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.975851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.975926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.976989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.977110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.977199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.977346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.977425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.977586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.977666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.977820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.977909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.978067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.978147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.978305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.978383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.978539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.978635 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.978774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.978855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.979973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.980112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.980220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.980373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.980498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.980589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.980756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.980852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.981564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.981654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.981902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.981981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.982146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.982384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.982473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.982616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.982694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.982856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.982944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.983093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.983224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.983329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.983409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.983570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.983660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.983813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.983893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.984049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.984128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.984279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.987702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.987702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.987881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.987944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988386 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.988985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.989961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.990996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.991943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992751 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.992980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.993959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994633 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.994951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.995119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.995207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.995368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.995449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.995603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.995681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.995840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.995928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.996075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.996154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.996337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.996421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.996599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.997300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.997387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.997559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.997650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.997971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.998050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.998221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.998303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.998458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.998538 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.998695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.998774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.998936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.999018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.999214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.999328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.999440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.999522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.999683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.999766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:28.999937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.000017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.000178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.000256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.000446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.000529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.000698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.000779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.000935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001497 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.001970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.002126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.002204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.002366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.002445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.002601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.002683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.002845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.002925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.003076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.003156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.003323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.003405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.003569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.003648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.003813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.003891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.004046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.004126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.004319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.004407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.004565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.004667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.004810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.004894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.005057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.005137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.005290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.005454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.005536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.005694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.005774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.005947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.006027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.006199 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.006280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.006449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.006609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.006688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.006845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.006942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.007093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.007179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.007340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.007436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.007586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.007674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.007832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.007914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.008065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.008144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.008314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.008408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.008574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.008718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.008801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.008876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009739 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009830 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.009976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.010057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.010214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.010294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.010456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.010543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.010691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.010770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.010921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.011952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.012121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.012199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.012448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.012531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.012698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.012936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.013017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.013184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.013263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.013464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.013554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.013700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.013790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.013968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.014075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.014185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.014262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.014409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.014500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.014656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.014736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.014930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.015008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.015160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.015252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.015401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.015482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.015637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.015715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.015876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.016917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.017073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.017153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.017309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.017387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.017549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.017638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.017781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.017860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.018885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 10:05:29.018960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.019193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.019437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.019668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.019906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.020139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 10:05:29.020330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81596) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 10:05:29.048782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.049013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.049247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.050002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.050234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.050464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.057591 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.058903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.086051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.086226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.087661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.087894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.149463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.149639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.203321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.203469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.203542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.203613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.361911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.362148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.362373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.362596 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.362786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.362876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.363011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.363095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.363231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.363450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.363667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.363881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.385745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.385971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.386094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.386179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.386355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.386451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.386585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.386669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.386799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.386881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.387010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.387094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.387244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.387543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.398275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.403445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.416171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.416312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.416435 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.416548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.416666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.416768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.416889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.416975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.417105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.417188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.417317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.417402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.417529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81596) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.417612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 10:05:29.442758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.442966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 10:05:29.443311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.443396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.443515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 10:05:29.443599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 10:05:29.443796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.443903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.444058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.444142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 10:05:29.444357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.444595 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.444692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.444861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.444944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.445115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.454503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.454783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.454884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.455058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.455143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.455345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.455430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.455649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.462498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.462961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.465957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.466246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.466534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.466629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.466815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.466898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.467101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.467185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.467371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.467456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.467642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.467730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.467916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.468007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.468187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.468325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.468527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.468614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.475916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.476053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.476134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.476134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.492438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.492660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.493909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.494140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.494224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.494424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.499158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.499269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.499444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.499528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.499727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.499810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.506179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.506375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.506463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.506666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.510555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.510684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.512928 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513162 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.513973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.514267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.514555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.530719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.531002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.531280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.531561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.534892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.535401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.538186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.538485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.538574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.538783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.543007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.549654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.549762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.549945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.550177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.550403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.550489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.550703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.550798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.550988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.551073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.551270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.551354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.551547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.551642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.551937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.567479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.567775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.568029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.568115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.568336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.568452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.568605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.568889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.575750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.576223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.577404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.577946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.578945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.579226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.579477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.579754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.581948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.582249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.582471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.582651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.582760 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.582954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.583046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.583244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.583327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.583584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.595090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.595376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.595753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.596040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.596166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.596361 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.596482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.596647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.596765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.596942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.597050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.597345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.597623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.597908 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.616716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.616820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.616902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.616990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.618673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.619575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.620128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.621041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.621847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.622336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.622629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.622759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.623048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.623333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.629259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.629935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.630744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.631408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.633766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.634090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.634371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.634469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.634660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.634754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.634947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.635250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.643459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.643756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.643841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.644045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.644132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.644469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.651134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81596) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.651330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 10:05:29.651431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.651619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.651704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.651899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.651984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.652175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.652269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.652472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.652557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.652764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.652882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.653697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.653785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.653978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.654060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.654252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.654346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.654522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.654604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.654787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.654868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.655046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.655137 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.655325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.655408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81596) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.655594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 10:05:29.691332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597872ec9c0 pid: 81597 (default app) Aug 28 10:05:29.691544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5597872ec9c0 pid: 81596 (default app) Aug 28 10:05:29.694862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad5013-4814-45ec-9431-f458048470b3 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:29.695151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad5013-4814-45ec-9431-f458048470b3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:29.695420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad5013-4814-45ec-9431-f458048470b3 None None] PATH_INFO: `/v3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:29.699566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Sun Aug 28 10:05:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:37.117097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fdc51-d394-464e-8d0d-1be97fcd7cac None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:37.117600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fdc51-d394-464e-8d0d-1be97fcd7cac None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:37.117682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fdc51-d394-464e-8d0d-1be97fcd7cac None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:37.122001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:37.127392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:37.127841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:37.127962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:37.201459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: INFO dbcounter [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] Registered counter for database keystone Aug 28 10:05:37.221201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG oslo_db.sqlalchemy.engines [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:05:37.227400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writer thread running {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:05:37.408228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG passlib.handlers.bcrypt [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81597) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 10:05:37.408606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG passlib.handlers.bcrypt [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81597) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 10:05:37.463485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:37.465109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:37.593163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 28 10:05:38.074654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fdc51-d394-464e-8d0d-1be97fcd7cac None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:38.145541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: INFO dbcounter [None req-305fdc51-d394-464e-8d0d-1be97fcd7cac None None] Registered counter for database keystone Aug 28 10:05:38.166898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG oslo_db.sqlalchemy.engines [None req-305fdc51-d394-464e-8d0d-1be97fcd7cac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81596) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 10:05:38.173766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writer thread running {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 10:05:38.291812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fdc51-d394-464e-8d0d-1be97fcd7cac None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:38.296701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82a07b-b565-44c2-a1e5-5e2a474c3f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:38.297336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a07b-b565-44c2-a1e5-5e2a474c3f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:38.297618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a07b-b565-44c2-a1e5-5e2a474c3f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:38.297892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82a07b-b565-44c2-a1e5-5e2a474c3f62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:38.305963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82a07b-b565-44c2-a1e5-5e2a474c3f62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:38.357870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3b82a07b-b565-44c2-a1e5-5e2a474c3f62 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 10:05:38.358209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82a07b-b565-44c2-a1e5-5e2a474c3f62 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:38.367549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Aug 28 10:05:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:05:38.373712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:38.387945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d4420-89c2-41e5-8547-da4af2a93efb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:38.392264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ffe3-b394-4b30-8f07-91ccc204ff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:38.393372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ffe3-b394-4b30-8f07-91ccc204ff1f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:38.393651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ffe3-b394-4b30-8f07-91ccc204ff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:38.393930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ffe3-b394-4b30-8f07-91ccc204ff1f admin admin] PATH_INFO: `/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:38.395492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93ffe3-b394-4b30-8f07-91ccc204ff1f admin admin] RBAC: Authorizing `identity:get_project(project_id=86f5f0c06d84427a9264fb27dee1d3a9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:38.448226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea93ffe3-b394-4b30-8f07-91ccc204ff1f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 10:05:38.448539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93ffe3-b394-4b30-8f07-91ccc204ff1f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:38.453087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Sun Aug 28 10:05:38 2022] GET /identity/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:40.334431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32323c6-763f-4bb2-87c8-248d12b89d2d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:40.334951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32323c6-763f-4bb2-87c8-248d12b89d2d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:40.334951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32323c6-763f-4bb2-87c8-248d12b89d2d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:40.339089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:40.344475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2cfb-b91e-44d6-94be-188592ccb293 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:40.344883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2cfb-b91e-44d6-94be-188592ccb293 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:40.345030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b2cfb-b91e-44d6-94be-188592ccb293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:40.365347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-879b2cfb-b91e-44d6-94be-188592ccb293 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:40.366859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-879b2cfb-b91e-44d6-94be-188592ccb293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:40.375475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 10:05:40.645323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32323c6-763f-4bb2-87c8-248d12b89d2d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:40.657811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32323c6-763f-4bb2-87c8-248d12b89d2d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:40.661958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f78c08-e085-4419-a3d1-9d68341bc3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:40.662556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f78c08-e085-4419-a3d1-9d68341bc3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:40.662839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f78c08-e085-4419-a3d1-9d68341bc3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:40.663113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f78c08-e085-4419-a3d1-9d68341bc3cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:40.671500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f78c08-e085-4419-a3d1-9d68341bc3cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:40.673294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f78c08-e085-4419-a3d1-9d68341bc3cb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:40.681885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Aug 28 10:05:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:05:40.687371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b2cfb-b91e-44d6-94be-188592ccb293 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:40.696418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b2cfb-b91e-44d6-94be-188592ccb293 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:40.700940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76609769-f259-480e-8c13-2ab675d63cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:40.701563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76609769-f259-480e-8c13-2ab675d63cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:40.701847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76609769-f259-480e-8c13-2ab675d63cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:40.702120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76609769-f259-480e-8c13-2ab675d63cfa admin admin] PATH_INFO: `/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:40.703433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76609769-f259-480e-8c13-2ab675d63cfa admin admin] RBAC: Authorizing `identity:get_user(user_id=41f4ecddb8d24b6f9cf0196547a5fb33)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:40.705319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76609769-f259-480e-8c13-2ab675d63cfa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:40.706834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Sun Aug 28 10:05:40 2022] GET /identity/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:42.677059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74928-cd9e-4282-8149-64f3df5294c3 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:42.677650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74928-cd9e-4282-8149-64f3df5294c3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:42.677650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74928-cd9e-4282-8149-64f3df5294c3 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:42.678946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:42.684173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120677-a9ae-4f39-9502-1d62485146e0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:42.684665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120677-a9ae-4f39-9502-1d62485146e0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:42.684768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120677-a9ae-4f39-9502-1d62485146e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:42.703511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2a120677-a9ae-4f39-9502-1d62485146e0 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:42.704826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2a120677-a9ae-4f39-9502-1d62485146e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:42.706806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ad9e-0c8d-4bfa-a359-f820f9d4766e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:42.707087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ad9e-0c8d-4bfa-a359-f820f9d4766e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:42.707362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2ad9e-0c8d-4bfa-a359-f820f9d4766e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:42.708716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:05:42.713811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:42.714158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:42.714811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:42.757400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG passlib.handlers.bcrypt [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81596) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 10:05:42.757826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG passlib.handlers.bcrypt [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81596) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 10:05:42.784383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:42.803853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:42.805488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:42.904789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:05:43.052834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a120677-a9ae-4f39-9502-1d62485146e0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:43.077528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:43.157443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a120677-a9ae-4f39-9502-1d62485146e0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:43.176590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:43.191315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b182151-a438-459b-94b1-702c52347325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:43.191953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182151-a438-459b-94b1-702c52347325 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:43.192229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182151-a438-459b-94b1-702c52347325 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:43.192539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b182151-a438-459b-94b1-702c52347325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:43.204457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b182151-a438-459b-94b1-702c52347325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8b182151-a438-459b-94b1-702c52347325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:05:43.213269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:43.214384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:05:43.215823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:05:43.220812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b182151-a438-459b-94b1-702c52347325 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:43.278838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792df7c2-a5ec-428b-a3cc-2ac22450501c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:43.281125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:43.307768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:43.316609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb118784-71f0-42c7-b2ae-a27606deb968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:43.317466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118784-71f0-42c7-b2ae-a27606deb968 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:43.317753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118784-71f0-42c7-b2ae-a27606deb968 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:43.318029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb118784-71f0-42c7-b2ae-a27606deb968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:43.321611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b182151-a438-459b-94b1-702c52347325 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:43.353814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:43.354762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:43.355248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:43.356636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:43.357325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:43.357632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:43.359039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:43.370429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:05:43.376475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:43.386823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb118784-71f0-42c7-b2ae-a27606deb968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:43.388555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb118784-71f0-42c7-b2ae-a27606deb968 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:43.476818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157cb25-abb0-4e36-a25a-74a21e2bdd66 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:43.485209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 10:05:43.490663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb118784-71f0-42c7-b2ae-a27606deb968 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:43.493377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:43.510806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b318-129c-4ff5-95ce-d90741b53569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:43.511441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b318-129c-4ff5-95ce-d90741b53569 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:43.511804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b318-129c-4ff5-95ce-d90741b53569 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:43.512735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98b318-129c-4ff5-95ce-d90741b53569 None admin] PATH_INFO: `/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:43.513893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98b318-129c-4ff5-95ce-d90741b53569 None admin] RBAC: Authorizing `identity:get_user(user_id=41f4ecddb8d24b6f9cf0196547a5fb33)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:43.515366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98b318-129c-4ff5-95ce-d90741b53569 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:43.517104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:05:43 2022] GET /identity/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:05:43.522654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b318-129c-4ff5-95ce-d90741b53569 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:43.537487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:43.591046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb118784-71f0-42c7-b2ae-a27606deb968 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:43.620719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98b318-129c-4ff5-95ce-d90741b53569 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:43.623973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:43.624847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:43.625128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:43.625399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:43.643752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:43.645238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:43.654475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9aac-56b1-4e1e-bfec-9c7960cae78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:43.655107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9aac-56b1-4e1e-bfec-9c7960cae78a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:43.655383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9aac-56b1-4e1e-bfec-9c7960cae78a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:43.655654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9aac-56b1-4e1e-bfec-9c7960cae78a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:43.656813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a9aac-56b1-4e1e-bfec-9c7960cae78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:43.658268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a9aac-56b1-4e1e-bfec-9c7960cae78a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:43.659842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:05:43.664586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:43.665704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:05:43.666527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:05:43.666527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:05:43.666527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:05:43.666527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:05:43.666746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9aac-56b1-4e1e-bfec-9c7960cae78a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:43.671669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:43.726752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:43.745137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:43.764913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9aac-56b1-4e1e-bfec-9c7960cae78a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:43.771330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef8565-e0a6-4c43-aa40-c2e0ec919733 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:43.799274 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c43f5e-bab6-41a1-add1-b7b55162ff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:43.799885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c43f5e-bab6-41a1-add1-b7b55162ff48 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:43.800174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c43f5e-bab6-41a1-add1-b7b55162ff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:43.800480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c43f5e-bab6-41a1-add1-b7b55162ff48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:43.801212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c43f5e-bab6-41a1-add1-b7b55162ff48 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.domain.id=default, user.id=41f4ecddb8d24b6f9cf0196547a5fb33) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:43.801523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c43f5e-bab6-41a1-add1-b7b55162ff48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:43.802994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c43f5e-bab6-41a1-add1-b7b55162ff48 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:43.805431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06c9d9-1db7-4523-afa0-367434f14105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:43.806033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06c9d9-1db7-4523-afa0-367434f14105 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:43.806312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06c9d9-1db7-4523-afa0-367434f14105 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:43.806583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06c9d9-1db7-4523-afa0-367434f14105 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:43.807224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06c9d9-1db7-4523-afa0-367434f14105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:43.807523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06c9d9-1db7-4523-afa0-367434f14105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:43.809469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06c9d9-1db7-4523-afa0-367434f14105 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:43.810311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Aug 28 10:05:43 2022] GET /identity/v3/role_assignments?user.id=41f4ecddb8d24b6f9cf0196547a5fb33&scope.domain.id=default&role.id=fe95a036fa044c4bb408b793fba6436a => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:05:43.830024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:05:46.052366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda052-a84a-4bbb-a2a1-96b880e317b7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.052872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda052-a84a-4bbb-a2a1-96b880e317b7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.052969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda052-a84a-4bbb-a2a1-96b880e317b7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.054229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:46.057583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020a42-5266-44d7-b33b-f9296ba0a2fe None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.058374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020a42-5266-44d7-b33b-f9296ba0a2fe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.058875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf020a42-5266-44d7-b33b-f9296ba0a2fe None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.060911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 11/23] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:46.066039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea62f7-53a2-42c9-970c-317b7948a233 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.066602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea62f7-53a2-42c9-970c-317b7948a233 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.067074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea62f7-53a2-42c9-970c-317b7948a233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.075203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb77fd-aea8-4acf-8fa4-fafc80df11f9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.075758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb77fd-aea8-4acf-8fa4-fafc80df11f9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.076239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb77fd-aea8-4acf-8fa4-fafc80df11f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.113573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4eea62f7-53a2-42c9-970c-317b7948a233 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:46.114790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4eea62f7-53a2-42c9-970c-317b7948a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:46.122448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a4fb77fd-aea8-4acf-8fa4-fafc80df11f9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:46.123706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a4fb77fd-aea8-4acf-8fa4-fafc80df11f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:46.199971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 10:05:46.201314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4616506-7dda-404e-bef9-eb2461836b8b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.201603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4616506-7dda-404e-bef9-eb2461836b8b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.201913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4616506-7dda-404e-bef9-eb2461836b8b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.203154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:46.211710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a14270-999b-4e0b-b624-136d7c3a71d5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.212001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a14270-999b-4e0b-b624-136d7c3a71d5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.212283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a14270-999b-4e0b-b624-136d7c3a71d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.249479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b3a14270-999b-4e0b-b624-136d7c3a71d5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:46.250979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b3a14270-999b-4e0b-b624-136d7c3a71d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:46.302740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:46.314298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:46.354790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:46.611842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea62f7-53a2-42c9-970c-317b7948a233 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:46.639355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a14270-999b-4e0b-b624-136d7c3a71d5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:46.726245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:46.753590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a14270-999b-4e0b-b624-136d7c3a71d5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:46.784590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea62f7-53a2-42c9-970c-317b7948a233 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:46.798930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae206-1f11-4124-ab17-a596173e50ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:46.799591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae206-1f11-4124-ab17-a596173e50ef None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.799876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae206-1f11-4124-ab17-a596173e50ef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.800155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae206-1f11-4124-ab17-a596173e50ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.834752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ae206-1f11-4124-ab17-a596173e50ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-136ae206-1f11-4124-ab17-a596173e50ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:05:46.842811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:46.843702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:05:46.844485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 15/28] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:05:46.859651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae206-1f11-4124-ab17-a596173e50ef None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:46.864126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d32a29-4dba-4234-b6ee-a8f8f6557673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:46.864757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32a29-4dba-4234-b6ee-a8f8f6557673 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.865041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32a29-4dba-4234-b6ee-a8f8f6557673 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.865314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d32a29-4dba-4234-b6ee-a8f8f6557673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.902923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32a29-4dba-4234-b6ee-a8f8f6557673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:46.904473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d32a29-4dba-4234-b6ee-a8f8f6557673 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-66d32a29-4dba-4234-b6ee-a8f8f6557673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:05:46.922148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:46.923074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:05:46.923885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:05:46.923885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:05:46.923885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:05:46.923885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 14/29] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:05:46.924835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3d7d-e8f2-4c08-b848-2da8c28c301f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:46.925028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3d7d-e8f2-4c08-b848-2da8c28c301f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:46.925261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e3d7d-e8f2-4c08-b848-2da8c28c301f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:46.926657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 15/30] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:46.927166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3d7d-e8f2-4c08-b848-2da8c28c301f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:46.935592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:47.029609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae206-1f11-4124-ab17-a596173e50ef None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:47.048151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e3d7d-e8f2-4c08-b848-2da8c28c301f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:47.079711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:47.081439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:47.082800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.083233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.083794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.085103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:47.085683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:47.087667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:47.089777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca786dc-84e2-451a-a949-caeb694cfb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:47.090745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca786dc-84e2-451a-a949-caeb694cfb22 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.097583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca786dc-84e2-451a-a949-caeb694cfb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.097583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca786dc-84e2-451a-a949-caeb694cfb22 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.097583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca786dc-84e2-451a-a949-caeb694cfb22 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:47.097583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca786dc-84e2-451a-a949-caeb694cfb22 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:47.101785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 16/31] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:47.102633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:47.207948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:47.212247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c309e-eacb-40e1-934e-72f822c2b5d3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:47.257694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b4661-7917-43e6-9f5e-6e94e5e75c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:47.258733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4661-7917-43e6-9f5e-6e94e5e75c75 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.259217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4661-7917-43e6-9f5e-6e94e5e75c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.259729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4661-7917-43e6-9f5e-6e94e5e75c75 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.260668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b4661-7917-43e6-9f5e-6e94e5e75c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:47.261186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b4661-7917-43e6-9f5e-6e94e5e75c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:47.262939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b4661-7917-43e6-9f5e-6e94e5e75c75 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:47.275673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 17/32] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:47.280222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028ebc-021b-4971-a2ff-9e3e6a8bdc99 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.280222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028ebc-021b-4971-a2ff-9e3e6a8bdc99 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.280222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028ebc-021b-4971-a2ff-9e3e6a8bdc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.299529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a4028ebc-021b-4971-a2ff-9e3e6a8bdc99 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:47.301107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a4028ebc-021b-4971-a2ff-9e3e6a8bdc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:47.344636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 16/33] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 10:05:46 2022] POST /identity/v3/roles => generated 219 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:05:47.346074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca786dc-84e2-451a-a949-caeb694cfb22 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:47.380115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 18/34] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:47.381602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028ebc-021b-4971-a2ff-9e3e6a8bdc99 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:47.503956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028ebc-021b-4971-a2ff-9e3e6a8bdc99 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:47.520690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:47.549474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256856e-feb6-492c-890d-340dc36f2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:47.551118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256856e-feb6-492c-890d-340dc36f2299 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.551725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256856e-feb6-492c-890d-340dc36f2299 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.552287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256856e-feb6-492c-890d-340dc36f2299 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.553391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256856e-feb6-492c-890d-340dc36f2299 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:47.555380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256856e-feb6-492c-890d-340dc36f2299 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:47.601632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca786dc-84e2-451a-a949-caeb694cfb22 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:47.641153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391740c-7438-4127-9d27-7de4942e1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:47.642177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391740c-7438-4127-9d27-7de4942e1657 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.642699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391740c-7438-4127-9d27-7de4942e1657 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.643193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391740c-7438-4127-9d27-7de4942e1657 None admin] PATH_INFO: `/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.644676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391740c-7438-4127-9d27-7de4942e1657 None admin] RBAC: Authorizing `identity:get_user(user_id=41f4ecddb8d24b6f9cf0196547a5fb33)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:47.646609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391740c-7438-4127-9d27-7de4942e1657 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:47.648567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 17/35] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:05:47 2022] GET /identity/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33 => generated 247 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:47.654791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391740c-7438-4127-9d27-7de4942e1657 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:47.735784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:47.792682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391740c-7438-4127-9d27-7de4942e1657 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:47.827664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 19/36] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:05:47 2022] POST /identity/v3/projects => generated 301 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:05:47.829240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4169d3b-b138-4595-8d47-b329bf9c988b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.829540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4169d3b-b138-4595-8d47-b329bf9c988b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.829822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4169d3b-b138-4595-8d47-b329bf9c988b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.835719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 20/37] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:47.835719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2480530-d847-4463-87e2-3451aee32951 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.835719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2480530-d847-4463-87e2-3451aee32951 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.835719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2480530-d847-4463-87e2-3451aee32951 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.835719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 21/38] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:47.837312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2480530-d847-4463-87e2-3451aee32951 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:47.839898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcbaaf-7489-4d99-8ab4-f8bea1a68ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:47.841166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcbaaf-7489-4d99-8ab4-f8bea1a68ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.841469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcbaaf-7489-4d99-8ab4-f8bea1a68ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.842786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcbaaf-7489-4d99-8ab4-f8bea1a68ba9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.844403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcbaaf-7489-4d99-8ab4-f8bea1a68ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:47.845934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcbaaf-7489-4d99-8ab4-f8bea1a68ba9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:47.848273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 18/39] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:47.849780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b071a-87fc-422e-8c40-9330bcbbf29d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:47.850050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b071a-87fc-422e-8c40-9330bcbbf29d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:47.850330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b071a-87fc-422e-8c40-9330bcbbf29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:47.965459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2480530-d847-4463-87e2-3451aee32951 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:47.981260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-362b071a-87fc-422e-8c40-9330bcbbf29d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:47.982582 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-362b071a-87fc-422e-8c40-9330bcbbf29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:48.008629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814192-f874-48cd-bcaf-3c6bf9476263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:48.009417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814192-f874-48cd-bcaf-3c6bf9476263 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:48.009542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814192-f874-48cd-bcaf-3c6bf9476263 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:48.009808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5814192-f874-48cd-bcaf-3c6bf9476263 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:48.010494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5814192-f874-48cd-bcaf-3c6bf9476263 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:48.012063 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5814192-f874-48cd-bcaf-3c6bf9476263 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:48.053361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 19/40] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:48.054539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00bc97-0066-48ee-b54f-85635c236b3d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:48.054826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00bc97-0066-48ee-b54f-85635c236b3d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:48.055099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00bc97-0066-48ee-b54f-85635c236b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:48.071975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2f00bc97-0066-48ee-b54f-85635c236b3d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:48.073173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2f00bc97-0066-48ee-b54f-85635c236b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:48.087283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:48.093044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 22/41] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 10:05:47 2022] POST /identity/v3/roles => generated 225 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:05:48.093827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814192-f874-48cd-bcaf-3c6bf9476263 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:48.172708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:48.182602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 20/42] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:48.238720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5814192-f874-48cd-bcaf-3c6bf9476263 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:48.274466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace42d-61ca-4880-babf-8bd3a294014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:48.275191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace42d-61ca-4880-babf-8bd3a294014c None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:48.275476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace42d-61ca-4880-babf-8bd3a294014c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:48.275757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddace42d-61ca-4880-babf-8bd3a294014c None admin] PATH_INFO: `/v3/domains/default/users/41f4ecddb8d24b6f9cf0196547a5fb33/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:48.278881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddace42d-61ca-4880-babf-8bd3a294014c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=41f4ecddb8d24b6f9cf0196547a5fb33, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:48.280410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddace42d-61ca-4880-babf-8bd3a294014c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:48.323381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00bc97-0066-48ee-b54f-85635c236b3d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:48.348983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Aug 28 10:05:48 2022] PUT /identity/v3/domains/default/users/41f4ecddb8d24b6f9cf0196547a5fb33/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:05:48.441298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00bc97-0066-48ee-b54f-85635c236b3d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:48.460518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace42d-61ca-4880-babf-8bd3a294014c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:48.479954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aabf5-f548-4479-91cf-c8a8e3301660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:48.481456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aabf5-f548-4479-91cf-c8a8e3301660 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:48.482030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aabf5-f548-4479-91cf-c8a8e3301660 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:48.482311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aabf5-f548-4479-91cf-c8a8e3301660 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:48.482997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aabf5-f548-4479-91cf-c8a8e3301660 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:48.484509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aabf5-f548-4479-91cf-c8a8e3301660 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:48.528782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:48.538913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 21/44] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 10:05:48 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:05:48.684216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddace42d-61ca-4880-babf-8bd3a294014c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:48.725744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e5ee4-b6bb-473c-91d9-0117340e75bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:48.726732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e5ee4-b6bb-473c-91d9-0117340e75bc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:48.727234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e5ee4-b6bb-473c-91d9-0117340e75bc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:48.727514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e5ee4-b6bb-473c-91d9-0117340e75bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:48.728680 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e5ee4-b6bb-473c-91d9-0117340e75bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:48.730144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e5ee4-b6bb-473c-91d9-0117340e75bc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:48.732963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:05:48.738504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aabf5-f548-4479-91cf-c8a8e3301660 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:48.783165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:48.844565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aabf5-f548-4479-91cf-c8a8e3301660 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:48.879476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64699ed6-b341-418f-b619-90d29eb87ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:48.880090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699ed6-b341-418f-b619-90d29eb87ac6 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:48.880405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699ed6-b341-418f-b619-90d29eb87ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:48.880687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699ed6-b341-418f-b619-90d29eb87ac6 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:48.881360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64699ed6-b341-418f-b619-90d29eb87ac6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:48.882816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64699ed6-b341-418f-b619-90d29eb87ac6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:48.972369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:05:48 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:05:50.282088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74835c7-2acf-4319-901d-3d5201b4b66a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:50.282620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74835c7-2acf-4319-901d-3d5201b4b66a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:50.282702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74835c7-2acf-4319-901d-3d5201b4b66a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:50.284124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:50.289205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f10e-4216-4bf3-a2a9-f5ef2a82e0ba None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:50.289612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f10e-4216-4bf3-a2a9-f5ef2a82e0ba None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:50.289779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f10e-4216-4bf3-a2a9-f5ef2a82e0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:50.309277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-daf3f10e-4216-4bf3-a2a9-f5ef2a82e0ba None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:50.310488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-daf3f10e-4216-4bf3-a2a9-f5ef2a82e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:50.375785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:50.644015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74835c7-2acf-4319-901d-3d5201b4b66a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:50.744253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74835c7-2acf-4319-901d-3d5201b4b66a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:50.770484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:50.778385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a3469-dde7-4086-b216-e063a2093671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:50.779014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3469-dde7-4086-b216-e063a2093671 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:50.779296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3469-dde7-4086-b216-e063a2093671 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:50.779568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a3469-dde7-4086-b216-e063a2093671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:50.789479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a3469-dde7-4086-b216-e063a2093671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-260a3469-dde7-4086-b216-e063a2093671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:05:50.795715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:50.796770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:05:50.797720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:05:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:05:50.804379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f10e-4216-4bf3-a2a9-f5ef2a82e0ba None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:50.829407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:50.879135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef847-e22a-48a9-9247-4ab479a161f1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:50.879422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef847-e22a-48a9-9247-4ab479a161f1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:50.879700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef847-e22a-48a9-9247-4ab479a161f1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:50.881094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 27/50] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:05:50.886142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9579f-b336-4c31-bb09-efe044797a0f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:50.886472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9579f-b336-4c31-bb09-efe044797a0f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:50.886882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9579f-b336-4c31-bb09-efe044797a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:50.904811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-53d9579f-b336-4c31-bb09-efe044797a0f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:50.906274 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-53d9579f-b336-4c31-bb09-efe044797a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:50.908276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f10e-4216-4bf3-a2a9-f5ef2a82e0ba None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:50.943157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:50.943775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:50.944065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:50.944377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:50.945063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:50.945371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:50.946782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:50.955097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 24/51] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:05:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:50.960461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:50.976749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 28/52] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:51.041544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:51.056104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b119-b721-4c9f-971e-90b88b08cb57 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:51.088842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d3bc-0618-48eb-a5b7-bb778d494a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:51.089468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d3bc-0618-48eb-a5b7-bb778d494a78 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:51.090290 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d3bc-0618-48eb-a5b7-bb778d494a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:51.090569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9d3bc-0618-48eb-a5b7-bb778d494a78 None admin] PATH_INFO: `/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:51.091751 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9d3bc-0618-48eb-a5b7-bb778d494a78 None admin] RBAC: Authorizing `identity:get_user(user_id=41f4ecddb8d24b6f9cf0196547a5fb33)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:51.093250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9d3bc-0618-48eb-a5b7-bb778d494a78 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:51.094835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 25/53] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:05:50 2022] GET /identity/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:05:51.100539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9579f-b336-4c31-bb09-efe044797a0f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:51.205984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9579f-b336-4c31-bb09-efe044797a0f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:51.223855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:51.240586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80972b-9ad9-4003-b9c0-9917aa2f8978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:51.241212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80972b-9ad9-4003-b9c0-9917aa2f8978 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:51.241493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80972b-9ad9-4003-b9c0-9917aa2f8978 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:51.241761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80972b-9ad9-4003-b9c0-9917aa2f8978 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:51.242861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80972b-9ad9-4003-b9c0-9917aa2f8978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:51.244384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80972b-9ad9-4003-b9c0-9917aa2f8978 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:51.245909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 29/54] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:51.247231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d3bc-0618-48eb-a5b7-bb778d494a78 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:51.251578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80972b-9ad9-4003-b9c0-9917aa2f8978 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:51.347795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9d3bc-0618-48eb-a5b7-bb778d494a78 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:51.350467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80972b-9ad9-4003-b9c0-9917aa2f8978 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:51.382523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feef9de-3f0b-476d-a714-16f5ae3d7aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:51.383163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feef9de-3f0b-476d-a714-16f5ae3d7aba None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:51.383440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feef9de-3f0b-476d-a714-16f5ae3d7aba None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:51.383718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feef9de-3f0b-476d-a714-16f5ae3d7aba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:51.384310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138baae-cd81-4dc0-9060-f0d77e941a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:51.384846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feef9de-3f0b-476d-a714-16f5ae3d7aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:51.384937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138baae-cd81-4dc0-9060-f0d77e941a3f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:51.385189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138baae-cd81-4dc0-9060-f0d77e941a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:51.385460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138baae-cd81-4dc0-9060-f0d77e941a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:51.386178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138baae-cd81-4dc0-9060-f0d77e941a3f None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.domain.id=default, user.id=41f4ecddb8d24b6f9cf0196547a5fb33) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:51.386298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feef9de-3f0b-476d-a714-16f5ae3d7aba None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:51.387048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138baae-cd81-4dc0-9060-f0d77e941a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:51.388599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138baae-cd81-4dc0-9060-f0d77e941a3f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:51.388759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 26/55] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:51.394262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feef9de-3f0b-476d-a714-16f5ae3d7aba None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:51.406511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 30/56] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Aug 28 10:05:51 2022] GET /identity/v3/role_assignments?user.id=41f4ecddb8d24b6f9cf0196547a5fb33&scope.domain.id=default&role.id=fe95a036fa044c4bb408b793fba6436a => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:05:51.422213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:51.503428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feef9de-3f0b-476d-a714-16f5ae3d7aba None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:51.542132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6170889-2933-400a-8c0f-65dfe0cbfa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:51.542132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6170889-2933-400a-8c0f-65dfe0cbfa8b None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:51.542502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6170889-2933-400a-8c0f-65dfe0cbfa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:51.542587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6170889-2933-400a-8c0f-65dfe0cbfa8b None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:51.543285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6170889-2933-400a-8c0f-65dfe0cbfa8b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:51.544790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6170889-2933-400a-8c0f-65dfe0cbfa8b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:51.617717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 27/57] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Aug 28 10:05:51 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:05:53.517074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9feb4c-fc04-46ca-96d0-4b2174781ea1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:53.517592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9feb4c-fc04-46ca-96d0-4b2174781ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:53.517676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9feb4c-fc04-46ca-96d0-4b2174781ea1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:53.518974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 31/58] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:53.524195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952cba-d157-4a06-8da4-6985bb0bca72 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:53.524632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952cba-d157-4a06-8da4-6985bb0bca72 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:53.524790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51952cba-d157-4a06-8da4-6985bb0bca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:53.544512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-51952cba-d157-4a06-8da4-6985bb0bca72 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:53.545698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-51952cba-d157-4a06-8da4-6985bb0bca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:53.609471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 28/59] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:05:53.881820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9feb4c-fc04-46ca-96d0-4b2174781ea1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:53.932838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:53.983280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9feb4c-fc04-46ca-96d0-4b2174781ea1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:54.016713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f87d-03e5-4cf8-aa18-35d0cc93c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:54.017331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f87d-03e5-4cf8-aa18-35d0cc93c59f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:54.017611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f87d-03e5-4cf8-aa18-35d0cc93c59f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:54.017901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f87d-03e5-4cf8-aa18-35d0cc93c59f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:54.018989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681f87d-03e5-4cf8-aa18-35d0cc93c59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:54.020446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681f87d-03e5-4cf8-aa18-35d0cc93c59f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:54.021988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 32/60] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:54.027626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952cba-d157-4a06-8da4-6985bb0bca72 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:54.030719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:54.125005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51952cba-d157-4a06-8da4-6985bb0bca72 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:54.157620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d38df-e2bd-4495-ae7c-46e1e10340b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:54.158221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d38df-e2bd-4495-ae7c-46e1e10340b5 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:54.158502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d38df-e2bd-4495-ae7c-46e1e10340b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:54.158774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d38df-e2bd-4495-ae7c-46e1e10340b5 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:54.159430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d38df-e2bd-4495-ae7c-46e1e10340b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:54.160924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d38df-e2bd-4495-ae7c-46e1e10340b5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:54.267956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 29/61] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:05:54 2022] POST /identity/v3/users => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:05:57.349855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817192a-09e2-48dc-a157-bd4b2356ace5 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:57.350368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817192a-09e2-48dc-a157-bd4b2356ace5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:57.350474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817192a-09e2-48dc-a157-bd4b2356ace5 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:57.352091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 33/62] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:57.357510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c6e2-881b-4234-b3bf-d1a105250feb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:57.359320 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c6e2-881b-4234-b3bf-d1a105250feb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:57.359812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c6e2-881b-4234-b3bf-d1a105250feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:57.381819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3098c6e2-881b-4234-b3bf-d1a105250feb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:57.383347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3098c6e2-881b-4234-b3bf-d1a105250feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:57.415322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56a40-9c8f-4f89-954d-4efea999d50c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:57.415923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56a40-9c8f-4f89-954d-4efea999d50c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:57.416493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56a40-9c8f-4f89-954d-4efea999d50c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:57.418677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 34/63] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:05:57.423838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa852-ed81-453f-a14d-6ce4d327fd30 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:57.424393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa852-ed81-453f-a14d-6ce4d327fd30 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:57.424767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa852-ed81-453f-a14d-6ce4d327fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:57.457805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a58aa852-ed81-453f-a14d-6ce4d327fd30 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:57.459533 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a58aa852-ed81-453f-a14d-6ce4d327fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:57.488669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:57.502207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 30/64] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:57.562999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 35/65] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:57.634900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57384-0dc3-4aa9-b50e-e2e6ff7895dd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:57.635186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57384-0dc3-4aa9-b50e-e2e6ff7895dd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:57.635651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57384-0dc3-4aa9-b50e-e2e6ff7895dd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:57.637405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 31/66] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:57.642740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c00f0-dbc3-495c-8c83-49d69ffeefba None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:57.643044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c00f0-dbc3-495c-8c83-49d69ffeefba None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:57.643332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c00f0-dbc3-495c-8c83-49d69ffeefba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:57.670344 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-197c00f0-dbc3-495c-8c83-49d69ffeefba None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:57.671558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-197c00f0-dbc3-495c-8c83-49d69ffeefba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:57.718222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24c9d-ce72-4833-b1e1-c96a2e540896 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:57.718647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24c9d-ce72-4833-b1e1-c96a2e540896 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:57.718769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24c9d-ce72-4833-b1e1-c96a2e540896 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:57.720123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 32/67] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:05:57.730978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:57.742567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370956-3beb-4885-bbfb-f087df533379 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:57.742859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370956-3beb-4885-bbfb-f087df533379 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:57.743138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99370956-3beb-4885-bbfb-f087df533379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:57.757570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 36/68] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:57.781521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-99370956-3beb-4885-bbfb-f087df533379 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:57.782922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-99370956-3beb-4885-bbfb-f087df533379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:57.862674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c00f0-dbc3-495c-8c83-49d69ffeefba None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:57.875838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 33/69] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:57.949393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99370956-3beb-4885-bbfb-f087df533379 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.017459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c00f0-dbc3-495c-8c83-49d69ffeefba None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.057831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99370956-3beb-4885-bbfb-f087df533379 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.062885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e8e80-8f38-4328-8734-5ec9eff6ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.064180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e8e80-8f38-4328-8734-5ec9eff6ee5c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.064789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e8e80-8f38-4328-8734-5ec9eff6ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.065213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e8e80-8f38-4328-8734-5ec9eff6ee5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.077962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e8e80-8f38-4328-8734-5ec9eff6ee5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:05:58.080833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-110e8e80-8f38-4328-8734-5ec9eff6ee5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:05:58.084009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:58.085917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:05:58.086852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:05:58.088930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 37/70] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:05:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:05:58.092617 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97970c-7df4-40fe-8448-e69fb5679971 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.092837 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97970c-7df4-40fe-8448-e69fb5679971 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.093481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97970c-7df4-40fe-8448-e69fb5679971 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.095561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 38/71] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:05:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:05:58.096701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97970c-7df4-40fe-8448-e69fb5679971 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.099734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4dda2-f99a-4e9a-8c7e-f250e6bd918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.100486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4dda2-f99a-4e9a-8c7e-f250e6bd918b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.100844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4dda2-f99a-4e9a-8c7e-f250e6bd918b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.101450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4dda2-f99a-4e9a-8c7e-f250e6bd918b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.124879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4dda2-f99a-4e9a-8c7e-f250e6bd918b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d5f4dda2-f99a-4e9a-8c7e-f250e6bd918b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:05:58.131390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:58.135688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 34/72] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:05:58.136811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053fcc-b587-4647-93ae-ef7709932e29 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.137494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053fcc-b587-4647-93ae-ef7709932e29 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.137494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053fcc-b587-4647-93ae-ef7709932e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.158820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-39053fcc-b587-4647-93ae-ef7709932e29 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:05:58.159843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:58.160055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-39053fcc-b587-4647-93ae-ef7709932e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:05:58.229661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97970c-7df4-40fe-8448-e69fb5679971 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.236066 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 35/73] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:05:58.236958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053fcc-b587-4647-93ae-ef7709932e29 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.271473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.272521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.273012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.273501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.274291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:58.274605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:58.276007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:58.289597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 39/74] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:58.289597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.351945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053fcc-b587-4647-93ae-ef7709932e29 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.364173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:58.391422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.392043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.392346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.392693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.393362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:58.394136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:58.395715 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:58.402076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:58.405949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5316f8-e48e-4406-b370-02bb8366e9fa None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.411151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 36/75] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:58.411151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.452055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888fab4-6918-4f8a-a9b5-d2e8fb47e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.452777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888fab4-6918-4f8a-a9b5-d2e8fb47e203 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.453073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888fab4-6918-4f8a-a9b5-d2e8fb47e203 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.453354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888fab4-6918-4f8a-a9b5-d2e8fb47e203 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.465708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888fab4-6918-4f8a-a9b5-d2e8fb47e203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6888fab4-6918-4f8a-a9b5-d2e8fb47e203 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:05:58.470645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:58.471515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:05:58.472270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 40/76] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:05:58.473017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888fab4-6918-4f8a-a9b5-d2e8fb47e203 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.539408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241286e-8413-4c7f-aa78-0940e6aa8e28 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.577989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eded2-683f-4ab5-96e6-35e16db1a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.578636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eded2-683f-4ab5-96e6-35e16db1a579 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.578919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eded2-683f-4ab5-96e6-35e16db1a579 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.579200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eded2-683f-4ab5-96e6-35e16db1a579 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.590197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eded2-683f-4ab5-96e6-35e16db1a579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:05:58.591797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888fab4-6918-4f8a-a9b5-d2e8fb47e203 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-883eded2-683f-4ab5-96e6-35e16db1a579 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:05:58.595938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:05:58.597020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:05:58.597810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 37/77] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:05:58.598433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eded2-683f-4ab5-96e6-35e16db1a579 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.630228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf81183-e353-4eaa-97e2-8b657ac957ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.630864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81183-e353-4eaa-97e2-8b657ac957ca None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.631151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81183-e353-4eaa-97e2-8b657ac957ca None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.631411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81183-e353-4eaa-97e2-8b657ac957ca None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.632960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:58.650273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf81183-e353-4eaa-97e2-8b657ac957ca None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:58.652889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf81183-e353-4eaa-97e2-8b657ac957ca None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:58.654573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 41/78] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:58.655344 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf81183-e353-4eaa-97e2-8b657ac957ca None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.678904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:58.710683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eded2-683f-4ab5-96e6-35e16db1a579 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.753181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3b681-513c-4cee-8800-b4b664166303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.753829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3b681-513c-4cee-8800-b4b664166303 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.754105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3b681-513c-4cee-8800-b4b664166303 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.754380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3b681-513c-4cee-8800-b4b664166303 None admin] PATH_INFO: `/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.755540 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3b681-513c-4cee-8800-b4b664166303 None admin] RBAC: Authorizing `identity:get_user(user_id=41f4ecddb8d24b6f9cf0196547a5fb33)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:58.757095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3b681-513c-4cee-8800-b4b664166303 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:58.758684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 38/79] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:58.759443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3b681-513c-4cee-8800-b4b664166303 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.769391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf81183-e353-4eaa-97e2-8b657ac957ca None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.804829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.805380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.805660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.805940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.806613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:58.806919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:58.808398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:58.816212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 42/80] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:58.817107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.861650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:58.865034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3b681-513c-4cee-8800-b4b664166303 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.898176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea9bd-1264-4c74-8107-c1c451ecfc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.898802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea9bd-1264-4c74-8107-c1c451ecfc7b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.899081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea9bd-1264-4c74-8107-c1c451ecfc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.899351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdea9bd-1264-4c74-8107-c1c451ecfc7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.900480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdea9bd-1264-4c74-8107-c1c451ecfc7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:58.902485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdea9bd-1264-4c74-8107-c1c451ecfc7b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:58.904065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:58.904166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 39/81] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:58.908690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea9bd-1264-4c74-8107-c1c451ecfc7b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:58.923461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dc861-855b-4ba0-aba0-a8fce0db9c5b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:58.959226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:58.959918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:58.960239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:58.960592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:58.961380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:05:58.961740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:58.963340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:58.972827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 43/82] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:58.973637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:59.011818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdea9bd-1264-4c74-8107-c1c451ecfc7b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.045745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765763-ab97-436d-83eb-2f86e9b6c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.046363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765763-ab97-436d-83eb-2f86e9b6c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.046646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765763-ab97-436d-83eb-2f86e9b6c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.046924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88765763-ab97-436d-83eb-2f86e9b6c4c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.072599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d873ed5-99cf-4d8a-a136-f77b8dfd114f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.081530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:59.107056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dc6a8-3f36-4740-9a1a-ac0d05646a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.107689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc6a8-3f36-4740-9a1a-ac0d05646a86 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.107966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc6a8-3f36-4740-9a1a-ac0d05646a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.108246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc6a8-3f36-4740-9a1a-ac0d05646a86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.117416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88765763-ab97-436d-83eb-2f86e9b6c4c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.118881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88765763-ab97-436d-83eb-2f86e9b6c4c9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:59.122318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:59.178445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dc6a8-3f36-4740-9a1a-ac0d05646a86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.179916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dc6a8-3f36-4740-9a1a-ac0d05646a86 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:59.217918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 40/83] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:05:59.218758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765763-ab97-436d-83eb-2f86e9b6c4c9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:59.281443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 44/84] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:05:59.282701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dc6a8-3f36-4740-9a1a-ac0d05646a86 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:59.287338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:59.321509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88765763-ab97-436d-83eb-2f86e9b6c4c9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.325575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:59.356303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c440a97-5b27-498a-84ba-da3ab0833c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.356957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440a97-5b27-498a-84ba-da3ab0833c80 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.357249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440a97-5b27-498a-84ba-da3ab0833c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.357529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c440a97-5b27-498a-84ba-da3ab0833c80 None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.358906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c440a97-5b27-498a-84ba-da3ab0833c80 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.360943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c440a97-5b27-498a-84ba-da3ab0833c80 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:59.362545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 41/85] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:05:59 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:59.367692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c440a97-5b27-498a-84ba-da3ab0833c80 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:59.386996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dc6a8-3f36-4740-9a1a-ac0d05646a86 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.421461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380ed5-4eef-4696-adc2-26bbb58e0543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.422090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380ed5-4eef-4696-adc2-26bbb58e0543 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.422373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380ed5-4eef-4696-adc2-26bbb58e0543 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.422643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380ed5-4eef-4696-adc2-26bbb58e0543 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.423299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39380ed5-4eef-4696-adc2-26bbb58e0543 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.424769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39380ed5-4eef-4696-adc2-26bbb58e0543 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:59.462836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c440a97-5b27-498a-84ba-da3ab0833c80 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.496662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350c545-e7ff-4dbc-b37a-199b8e936a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.497287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c545-e7ff-4dbc-b37a-199b8e936a07 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.497574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c545-e7ff-4dbc-b37a-199b8e936a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.497852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c545-e7ff-4dbc-b37a-199b8e936a07 None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.498998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350c545-e7ff-4dbc-b37a-199b8e936a07 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.500571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350c545-e7ff-4dbc-b37a-199b8e936a07 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:59.502266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 42/86] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:05:59 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:59.503027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350c545-e7ff-4dbc-b37a-199b8e936a07 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:59.506244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:59.513993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 45/87] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:05:59 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:05:59.514883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380ed5-4eef-4696-adc2-26bbb58e0543 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:59.616216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350c545-e7ff-4dbc-b37a-199b8e936a07 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.655878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bdce2-3095-441a-afd5-5f29bfba9d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.656546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdce2-3095-441a-afd5-5f29bfba9d39 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.656826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdce2-3095-441a-afd5-5f29bfba9d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.657102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86bdce2-3095-441a-afd5-5f29bfba9d39 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.658249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bdce2-3095-441a-afd5-5f29bfba9d39 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.658988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:59.659894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86bdce2-3095-441a-afd5-5f29bfba9d39 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:59.661410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 43/88] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:05:59 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:59.662954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bdce2-3095-441a-afd5-5f29bfba9d39 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:59.663136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380ed5-4eef-4696-adc2-26bbb58e0543 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.705116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b632f-a287-4a5a-8e87-67eb9443c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.705760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b632f-a287-4a5a-8e87-67eb9443c3cb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.706036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b632f-a287-4a5a-8e87-67eb9443c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.706313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b632f-a287-4a5a-8e87-67eb9443c3cb None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.707499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b632f-a287-4a5a-8e87-67eb9443c3cb None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.708998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b632f-a287-4a5a-8e87-67eb9443c3cb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:59.710638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 46/89] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:05:59 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:05:59.711411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b632f-a287-4a5a-8e87-67eb9443c3cb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:05:59.751423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:59.784595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86bdce2-3095-441a-afd5-5f29bfba9d39 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.833261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb776efa-cb8e-4882-8295-db6a7ff7d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.833952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb776efa-cb8e-4882-8295-db6a7ff7d70b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.834343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb776efa-cb8e-4882-8295-db6a7ff7d70b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.834624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb776efa-cb8e-4882-8295-db6a7ff7d70b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.845294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b632f-a287-4a5a-8e87-67eb9443c3cb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:05:59.887102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9d18e-15d3-4f15-b4ac-9179c5372ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:05:59.887719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9d18e-15d3-4f15-b4ac-9179c5372ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:05:59.887971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9d18e-15d3-4f15-b4ac-9179c5372ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:05:59.888241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9d18e-15d3-4f15-b4ac-9179c5372ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:05:59.913398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb776efa-cb8e-4882-8295-db6a7ff7d70b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.915254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb776efa-cb8e-4882-8295-db6a7ff7d70b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:05:59.936596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:05:59.980733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9d18e-15d3-4f15-b4ac-9179c5372ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:05:59.982195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9d18e-15d3-4f15-b4ac-9179c5372ba8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:00.003065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:00.036255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 44/90] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:00.041342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb776efa-cb8e-4882-8295-db6a7ff7d70b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:00.110980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 47/91] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:00.116221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9d18e-15d3-4f15-b4ac-9179c5372ba8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:00.156200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb776efa-cb8e-4882-8295-db6a7ff7d70b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:00.196500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:00.197219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:00.197508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:00.197787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:00.199285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] RBAC: Adding query filter params (role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=16145402c02e4b02a32a9d3478528966, user.id=fd0e69577dc04c68968f75a91a2c3aaf) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:00.199595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:00.201076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:00.207291 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 45/92] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:00 2022] GET /identity/v3/role_assignments?user.id=fd0e69577dc04c68968f75a91a2c3aaf&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:00.207996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:00.223066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:00.249287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:00.260248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9d18e-15d3-4f15-b4ac-9179c5372ba8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:00.298477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:00.299106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:00.299388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:00.299663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:00.300545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=16145402c02e4b02a32a9d3478528966, user.id=41f4ecddb8d24b6f9cf0196547a5fb33) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:00.300863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:00.302370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:00.308760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 48/93] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:00 2022] GET /identity/v3/role_assignments?user.id=41f4ecddb8d24b6f9cf0196547a5fb33&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=fe95a036fa044c4bb408b793fba6436a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:00.309622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:00.356915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9a631-5b3e-4c2a-854b-bc63c59bf858 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:00.445341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcc62a-1f25-45db-ae31-f1a825b509a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:00.445953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc62a-1f25-45db-ae31-f1a825b509a7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:00.446209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc62a-1f25-45db-ae31-f1a825b509a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:00.446488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcc62a-1f25-45db-ae31-f1a825b509a7 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:00.447664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcc62a-1f25-45db-ae31-f1a825b509a7 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:00.450015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcc62a-1f25-45db-ae31-f1a825b509a7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:00.451852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 46/94] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:00 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:00.458144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcc62a-1f25-45db-ae31-f1a825b509a7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:00.468805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef18025-a8cd-4610-aeb8-788ad8e6d539 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:00.504761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:00.513479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f6db-b201-4f39-bc70-4032e5165cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:00.514135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f6db-b201-4f39-bc70-4032e5165cbe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:00.514417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f6db-b201-4f39-bc70-4032e5165cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:00.514767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f6db-b201-4f39-bc70-4032e5165cbe None admin] PATH_INFO: `/v3/projects/231ee93a1f944a35b1b5aedffbf8ba62` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:00.516077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116f6db-b201-4f39-bc70-4032e5165cbe None admin] RBAC: Authorizing `identity:get_project(project_id=231ee93a1f944a35b1b5aedffbf8ba62)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:00.517584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116f6db-b201-4f39-bc70-4032e5165cbe None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:00.521690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 49/95] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:00 2022] GET /identity/v3/projects/231ee93a1f944a35b1b5aedffbf8ba62 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:00.526814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f6db-b201-4f39-bc70-4032e5165cbe None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:00.615753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcc62a-1f25-45db-ae31-f1a825b509a7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:00.620001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:00.697099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5811ebc-478f-452f-b7c0-db025d9b9179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:00.697646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5811ebc-478f-452f-b7c0-db025d9b9179 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:00.697935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5811ebc-478f-452f-b7c0-db025d9b9179 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:00.698213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5811ebc-478f-452f-b7c0-db025d9b9179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:00.699037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5811ebc-478f-452f-b7c0-db025d9b9179 None admin] RBAC: Adding query filter params (role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=16145402c02e4b02a32a9d3478528966, user.id=fd0e69577dc04c68968f75a91a2c3aaf) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:00.699343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5811ebc-478f-452f-b7c0-db025d9b9179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:00.700859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5811ebc-478f-452f-b7c0-db025d9b9179 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:00.701522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f6db-b201-4f39-bc70-4032e5165cbe None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:00.710824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 47/96] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:00 2022] GET /identity/v3/role_assignments?user.id=fd0e69577dc04c68968f75a91a2c3aaf&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:00.751568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54984df3-8407-4810-bd0d-fc2047c7067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:00.752198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54984df3-8407-4810-bd0d-fc2047c7067e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:00.752505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54984df3-8407-4810-bd0d-fc2047c7067e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:00.752781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54984df3-8407-4810-bd0d-fc2047c7067e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:00.753528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54984df3-8407-4810-bd0d-fc2047c7067e None admin] RBAC: Adding query filter params (role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=231ee93a1f944a35b1b5aedffbf8ba62, user.id=fd0e69577dc04c68968f75a91a2c3aaf) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:00.753834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54984df3-8407-4810-bd0d-fc2047c7067e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:00.755284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54984df3-8407-4810-bd0d-fc2047c7067e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:00.761783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 50/97] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:00 2022] GET /identity/v3/role_assignments?user.id=fd0e69577dc04c68968f75a91a2c3aaf&scope.project.id=231ee93a1f944a35b1b5aedffbf8ba62&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:02.248354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128d6a-6e4d-4c71-b449-e813a9ae1350 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:02.249389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128d6a-6e4d-4c71-b449-e813a9ae1350 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:02.249872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4128d6a-6e4d-4c71-b449-e813a9ae1350 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:02.251452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 48/98] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:02.257041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d47fb-0f4f-4231-aab3-adc1ec81da82 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:02.257939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d47fb-0f4f-4231-aab3-adc1ec81da82 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:02.258429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d47fb-0f4f-4231-aab3-adc1ec81da82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:02.277135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4a1d47fb-0f4f-4231-aab3-adc1ec81da82 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:02.278715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4a1d47fb-0f4f-4231-aab3-adc1ec81da82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:02.344216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:02.361848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 51/99] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:02.536901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463956-afcf-4e7d-aefc-a02836ce417f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:02.537496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463956-afcf-4e7d-aefc-a02836ce417f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:02.537984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463956-afcf-4e7d-aefc-a02836ce417f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:02.539548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 49/100] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:02.555431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a923e-1677-4e3c-849d-8c650ab1927f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:02.555734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a923e-1677-4e3c-849d-8c650ab1927f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:02.555996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a923e-1677-4e3c-849d-8c650ab1927f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:02.585264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bb1a923e-1677-4e3c-849d-8c650ab1927f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:02.586456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bb1a923e-1677-4e3c-849d-8c650ab1927f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:02.656625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 52/101] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:02.744159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456f3f-6bc8-48d2-a2bb-b87e37ad64dd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:02.744836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456f3f-6bc8-48d2-a2bb-b87e37ad64dd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:02.745323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456f3f-6bc8-48d2-a2bb-b87e37ad64dd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:02.747763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 50/102] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:02.753794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171f84-26ef-4cf2-94e3-74d51d5e9192 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:02.754134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171f84-26ef-4cf2-94e3-74d51d5e9192 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:02.754358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af171f84-26ef-4cf2-94e3-74d51d5e9192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:02.781334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-af171f84-26ef-4cf2-94e3-74d51d5e9192 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:02.782540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-af171f84-26ef-4cf2-94e3-74d51d5e9192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:02.824208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31456f3f-6bc8-48d2-a2bb-b87e37ad64dd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:02.915474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 53/103] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:03.005074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31456f3f-6bc8-48d2-a2bb-b87e37ad64dd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:03.022674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171f84-26ef-4cf2-94e3-74d51d5e9192 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:03.061321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c69e3-f1bc-42b6-9808-9eb929d96a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:03.061958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c69e3-f1bc-42b6-9808-9eb929d96a2d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.062242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c69e3-f1bc-42b6-9808-9eb929d96a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.062520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c69e3-f1bc-42b6-9808-9eb929d96a2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.078868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c69e3-f1bc-42b6-9808-9eb929d96a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c57c69e3-f1bc-42b6-9808-9eb929d96a2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:03.083934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:03.084830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:03.085601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 51/104] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:03.095884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c69e3-f1bc-42b6-9808-9eb929d96a2d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:03.128482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:03.135580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:03.259669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c69e3-f1bc-42b6-9808-9eb929d96a2d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:03.282116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af171f84-26ef-4cf2-94e3-74d51d5e9192 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:03.314910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e250d0-0072-4b3f-9770-6c36dd0b3da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:03.315854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e250d0-0072-4b3f-9770-6c36dd0b3da5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.316394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e250d0-0072-4b3f-9770-6c36dd0b3da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.316870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e250d0-0072-4b3f-9770-6c36dd0b3da5 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.317766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e250d0-0072-4b3f-9770-6c36dd0b3da5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:03.318266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e250d0-0072-4b3f-9770-6c36dd0b3da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:03.319846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e250d0-0072-4b3f-9770-6c36dd0b3da5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:03.332516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 52/105] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:03.334059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa923a3-7ee4-4d6a-bc12-02b1f770e370 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.338926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa923a3-7ee4-4d6a-bc12-02b1f770e370 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.340148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa923a3-7ee4-4d6a-bc12-02b1f770e370 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.341972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 53/106] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:03.342919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa923a3-7ee4-4d6a-bc12-02b1f770e370 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:03.363677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27affe0-4831-4bb7-9e28-a5b2fc6b1c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:03.364902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27affe0-4831-4bb7-9e28-a5b2fc6b1c7c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.366459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27affe0-4831-4bb7-9e28-a5b2fc6b1c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.366939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27affe0-4831-4bb7-9e28-a5b2fc6b1c7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.370914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27affe0-4831-4bb7-9e28-a5b2fc6b1c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:03.375122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27affe0-4831-4bb7-9e28-a5b2fc6b1c7c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:03.377505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 54/107] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:03.379858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b46c90-579f-4042-9e2b-374caaf987fb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.380551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b46c90-579f-4042-9e2b-374caaf987fb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.382296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b46c90-579f-4042-9e2b-374caaf987fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.411016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-16b46c90-579f-4042-9e2b-374caaf987fb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:03.412408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-16b46c90-579f-4042-9e2b-374caaf987fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:03.463406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:03.477342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa923a3-7ee4-4d6a-bc12-02b1f770e370 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:03.495047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 55/108] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:03.496234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b46c90-579f-4042-9e2b-374caaf987fb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:03.542397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec6458-3f3c-44d8-bfba-8b8f501a829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:03.544271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec6458-3f3c-44d8-bfba-8b8f501a829c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.545395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec6458-3f3c-44d8-bfba-8b8f501a829c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.546023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec6458-3f3c-44d8-bfba-8b8f501a829c None admin] PATH_INFO: `/v3/users/6d9e3decbbcf41b493adb5f2997ffd79` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.575122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec6458-3f3c-44d8-bfba-8b8f501a829c None admin] RBAC: Authorizing `identity:get_user(user_id=6d9e3decbbcf41b493adb5f2997ffd79)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:03.578099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec6458-3f3c-44d8-bfba-8b8f501a829c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:03.580011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 54/109] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:03 2022] GET /identity/v3/users/6d9e3decbbcf41b493adb5f2997ffd79 => generated 289 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:03.581928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec6458-3f3c-44d8-bfba-8b8f501a829c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:03.592461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:03.658158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b46c90-579f-4042-9e2b-374caaf987fb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:03.696977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4eef4-11d2-473b-a2bb-9c35685b09ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:03.698168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4eef4-11d2-473b-a2bb-9c35685b09ef None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.699189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4eef4-11d2-473b-a2bb-9c35685b09ef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.699672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4eef4-11d2-473b-a2bb-9c35685b09ef None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.700615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4eef4-11d2-473b-a2bb-9c35685b09ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:03.701616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec6458-3f3c-44d8-bfba-8b8f501a829c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:03.702799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4eef4-11d2-473b-a2bb-9c35685b09ef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:03.736130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee140-bbca-490b-8fb6-74eff9954dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:03.736790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee140-bbca-490b-8fb6-74eff9954dda None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.737070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee140-bbca-490b-8fb6-74eff9954dda None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.737340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee140-bbca-490b-8fb6-74eff9954dda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.748410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee140-bbca-490b-8fb6-74eff9954dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ebcee140-bbca-490b-8fb6-74eff9954dda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:03.753332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:03.754189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:03.754979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 55/110] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:03.756064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee140-bbca-490b-8fb6-74eff9954dda None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:03.769581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:03.815193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 56/111] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:06:03 2022] POST /identity/v3/projects => generated 302 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:03.821414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38fc0-d327-4de7-889a-63cd6158b1d8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.822012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38fc0-d327-4de7-889a-63cd6158b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.822513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f38fc0-d327-4de7-889a-63cd6158b1d8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.824767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 57/112] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:03.825962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f38fc0-d327-4de7-889a-63cd6158b1d8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:03.876539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee140-bbca-490b-8fb6-74eff9954dda None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:03.916735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8acc2-3cac-4a47-a692-61ca416ef7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:03.917432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8acc2-3cac-4a47-a692-61ca416ef7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:03.917720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8acc2-3cac-4a47-a692-61ca416ef7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:03.917999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8acc2-3cac-4a47-a692-61ca416ef7a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:03.958407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f38fc0-d327-4de7-889a-63cd6158b1d8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:03.960227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:03.995120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8acc2-3cac-4a47-a692-61ca416ef7a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:03.997446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8acc2-3cac-4a47-a692-61ca416ef7a7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:04.001964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.002610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.002895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.003169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.003856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:04.004160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:04.005561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:04.010226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:04.018025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 58/113] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:04.019111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.106245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 56/114] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:04.107536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d548d-5598-4fdd-a1e6-d615d46aa1cd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.107826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d548d-5598-4fdd-a1e6-d615d46aa1cd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.108103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d548d-5598-4fdd-a1e6-d615d46aa1cd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.109394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 57/115] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:04.110405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2f2f-ac81-4daf-95f3-4cf9518616c2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.110686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2f2f-ac81-4daf-95f3-4cf9518616c2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.110961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2f2f-ac81-4daf-95f3-4cf9518616c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.129011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-194a2f2f-ac81-4daf-95f3-4cf9518616c2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:04.130122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-194a2f2f-ac81-4daf-95f3-4cf9518616c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:04.137462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8c4df-6300-4bf9-9106-2c42c1e80ad2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.176240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68402721-96e0-4ded-8c2d-3149b76e2583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.177007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402721-96e0-4ded-8c2d-3149b76e2583 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.177301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402721-96e0-4ded-8c2d-3149b76e2583 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.177580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68402721-96e0-4ded-8c2d-3149b76e2583 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.189481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68402721-96e0-4ded-8c2d-3149b76e2583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-68402721-96e0-4ded-8c2d-3149b76e2583 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:04.195456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:04.200573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 59/116] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:04.201731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68402721-96e0-4ded-8c2d-3149b76e2583 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.204415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 58/117] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:04.205481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2f2f-ac81-4daf-95f3-4cf9518616c2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.235105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:04.258543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:04.314178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68402721-96e0-4ded-8c2d-3149b76e2583 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.336098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2f2f-ac81-4daf-95f3-4cf9518616c2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.349699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8bb93-7cb0-4dcd-b78a-a3f802b12cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.350380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8bb93-7cb0-4dcd-b78a-a3f802b12cda None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.350657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8bb93-7cb0-4dcd-b78a-a3f802b12cda None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.350931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8bb93-7cb0-4dcd-b78a-a3f802b12cda None admin] PATH_INFO: `/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.352390 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8bb93-7cb0-4dcd-b78a-a3f802b12cda None admin] RBAC: Authorizing `identity:get_user(user_id=41f4ecddb8d24b6f9cf0196547a5fb33)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:04.353840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8bb93-7cb0-4dcd-b78a-a3f802b12cda None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:04.356540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 60/118] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:04.361148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8218385-ad57-465d-9627-69b44d7e30bc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.361148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8218385-ad57-465d-9627-69b44d7e30bc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.361148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8218385-ad57-465d-9627-69b44d7e30bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.377513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c8218385-ad57-465d-9627-69b44d7e30bc None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:04.378767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c8218385-ad57-465d-9627-69b44d7e30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:04.386410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19c8d-f528-4545-a0cc-701e0a2197e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.387778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19c8d-f528-4545-a0cc-701e0a2197e8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.388251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19c8d-f528-4545-a0cc-701e0a2197e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.388711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19c8d-f528-4545-a0cc-701e0a2197e8 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.390888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf19c8d-f528-4545-a0cc-701e0a2197e8 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:04.392898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf19c8d-f528-4545-a0cc-701e0a2197e8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:04.400842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 59/119] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:04.401712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19c8d-f528-4545-a0cc-701e0a2197e8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.457730 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 61/120] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:04.458422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8218385-ad57-465d-9627-69b44d7e30bc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.485334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:04.548405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19c8d-f528-4545-a0cc-701e0a2197e8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.557976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:04.575944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8218385-ad57-465d-9627-69b44d7e30bc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.584437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.585050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.585330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.585602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.586270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:04.586620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:04.588006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:04.597538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 60/121] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:04.598299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.623209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799c772-cc9d-4339-8287-2d247a75f1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.624910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c772-cc9d-4339-8287-2d247a75f1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.625406 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c772-cc9d-4339-8287-2d247a75f1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.626127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c772-cc9d-4339-8287-2d247a75f1f2 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.628108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799c772-cc9d-4339-8287-2d247a75f1f2 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:04.630351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799c772-cc9d-4339-8287-2d247a75f1f2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:04.632910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 62/122] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:04.634290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799c772-cc9d-4339-8287-2d247a75f1f2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.718336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2120-1695-406f-b413-129d7baa7340 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.748125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799c772-cc9d-4339-8287-2d247a75f1f2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.751976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:04.760919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.761699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.762156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.762437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.763186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] RBAC: Adding query filter params (role.id=96c3f321e7a94ce88e601331d741c325, scope.project.id=16145402c02e4b02a32a9d3478528966, user.id=6d9e3decbbcf41b493adb5f2997ffd79) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:04.765374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:04.765374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:04.770603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 61/123] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/role_assignments?user.id=6d9e3decbbcf41b493adb5f2997ffd79&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=96c3f321e7a94ce88e601331d741c325 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:04.781368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.792039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21125db-b17f-4d44-81a7-5cd595ebeeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.794650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21125db-b17f-4d44-81a7-5cd595ebeeaa None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.795130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21125db-b17f-4d44-81a7-5cd595ebeeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.795629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21125db-b17f-4d44-81a7-5cd595ebeeaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.810754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21125db-b17f-4d44-81a7-5cd595ebeeaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a21125db-b17f-4d44-81a7-5cd595ebeeaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:04.817840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:04.818951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:04.819881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:04.822044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 63/124] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:04.824673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21125db-b17f-4d44-81a7-5cd595ebeeaa None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.836687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:04.914001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cf59d-f3d6-4d18-9f7c-ba2c54dd8055 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.945396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21125db-b17f-4d44-81a7-5cd595ebeeaa None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:04.957677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa353f9-5283-4fe6-9796-7cf4ea4c67ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.958324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa353f9-5283-4fe6-9796-7cf4ea4c67ca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.958605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa353f9-5283-4fe6-9796-7cf4ea4c67ca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.958881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa353f9-5283-4fe6-9796-7cf4ea4c67ca None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.960022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa353f9-5283-4fe6-9796-7cf4ea4c67ca None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:04.961759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa353f9-5283-4fe6-9796-7cf4ea4c67ca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:04.963589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 62/125] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:04.964786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa353f9-5283-4fe6-9796-7cf4ea4c67ca None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:04.986734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60a5b-0168-4491-aa63-e4ff8a8a203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:04.987523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60a5b-0168-4491-aa63-e4ff8a8a203e None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:04.987914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60a5b-0168-4491-aa63-e4ff8a8a203e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:04.988316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d60a5b-0168-4491-aa63-e4ff8a8a203e None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966/users/41f4ecddb8d24b6f9cf0196547a5fb33/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:04.990380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d60a5b-0168-4491-aa63-e4ff8a8a203e None admin] RBAC: Authorizing `identity:create_grant(project_id=16145402c02e4b02a32a9d3478528966, user_id=41f4ecddb8d24b6f9cf0196547a5fb33, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:04.991924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d60a5b-0168-4491-aa63-e4ff8a8a203e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:05.043648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 64/126] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:04 2022] PUT /identity/v3/projects/16145402c02e4b02a32a9d3478528966/users/41f4ecddb8d24b6f9cf0196547a5fb33/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:05.044786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60a5b-0168-4491-aa63-e4ff8a8a203e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:05.068816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:05.100072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:05.105675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa353f9-5283-4fe6-9796-7cf4ea4c67ca None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:05.178673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d60a5b-0168-4491-aa63-e4ff8a8a203e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:05.189537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a863c-9c8e-4d68-80ff-c523eaf2eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:05.190216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a863c-9c8e-4d68-80ff-c523eaf2eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:05.190503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a863c-9c8e-4d68-80ff-c523eaf2eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:05.190782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a863c-9c8e-4d68-80ff-c523eaf2eeb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:05.204866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a863c-9c8e-4d68-80ff-c523eaf2eeb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-988a863c-9c8e-4d68-80ff-c523eaf2eeb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:05.210872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:05.211890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:05.212701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 63/127] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:05.213341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a863c-9c8e-4d68-80ff-c523eaf2eeb9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:05.261067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:05.261884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:05.262297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:05.262573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:05.263258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:05.263562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:05.264987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:05.278036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 65/128] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:05.278842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:05.357343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:05.382841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a863c-9c8e-4d68-80ff-c523eaf2eeb9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:05.391771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61999c-f629-4add-92cf-7a5554c51723 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:05.428464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:05.429080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:05.429363 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:05.429639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:05.430308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:05.430610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:05.431282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a06d-dd58-40a4-b064-bd8d577db386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:05.431976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a06d-dd58-40a4-b064-bd8d577db386 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:05.432076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:05.432266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a06d-dd58-40a4-b064-bd8d577db386 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:05.432569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a06d-dd58-40a4-b064-bd8d577db386 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:05.434508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a06d-dd58-40a4-b064-bd8d577db386 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:05.436494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a06d-dd58-40a4-b064-bd8d577db386 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:05.439109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 64/129] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:05 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:05.440286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a06d-dd58-40a4-b064-bd8d577db386 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:05.441704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 66/130] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:05.446702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:05.477257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:05.592783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7395a-22be-4353-b7fb-5d8e680a3149 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:05.602146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a06d-dd58-40a4-b064-bd8d577db386 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:05.630159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cf98-434e-47c1-ad1c-dda724b41409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:05.630946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cf98-434e-47c1-ad1c-dda724b41409 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:05.631239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cf98-434e-47c1-ad1c-dda724b41409 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:05.631520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cf98-434e-47c1-ad1c-dda724b41409 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966/users/fd0e69577dc04c68968f75a91a2c3aaf/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:05.633690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8cf98-434e-47c1-ad1c-dda724b41409 None admin] RBAC: Authorizing `identity:create_grant(project_id=16145402c02e4b02a32a9d3478528966, user_id=fd0e69577dc04c68968f75a91a2c3aaf, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:05.635144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8cf98-434e-47c1-ad1c-dda724b41409 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:05.637385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:05.658696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e888e-83a3-4207-8c37-1e96a9751112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:05.659404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e888e-83a3-4207-8c37-1e96a9751112 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:05.659759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e888e-83a3-4207-8c37-1e96a9751112 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:05.660045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e888e-83a3-4207-8c37-1e96a9751112 None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:05.661273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e888e-83a3-4207-8c37-1e96a9751112 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:05.662740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e888e-83a3-4207-8c37-1e96a9751112 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:05.664683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 65/131] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:05 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:05.665702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e888e-83a3-4207-8c37-1e96a9751112 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:05.718244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 67/132] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:05 2022] PUT /identity/v3/projects/16145402c02e4b02a32a9d3478528966/users/fd0e69577dc04c68968f75a91a2c3aaf/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:05.721371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cf98-434e-47c1-ad1c-dda724b41409 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:05.784221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:05.798731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e888e-83a3-4207-8c37-1e96a9751112 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:05.850921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cf98-434e-47c1-ad1c-dda724b41409 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:05.867554 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b00a4d-55ac-4e7d-91cd-8674e984cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:05.868638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b00a4d-55ac-4e7d-91cd-8674e984cc91 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:05.869121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b00a4d-55ac-4e7d-91cd-8674e984cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:05.869621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b00a4d-55ac-4e7d-91cd-8674e984cc91 None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:05.873318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b00a4d-55ac-4e7d-91cd-8674e984cc91 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:05.875095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b00a4d-55ac-4e7d-91cd-8674e984cc91 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:05.876996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 66/133] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:05 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:05.882344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b00a4d-55ac-4e7d-91cd-8674e984cc91 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:05.889783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec87b2-23e0-4c20-a78d-bf444aab120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:05.890006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec87b2-23e0-4c20-a78d-bf444aab120e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:05.890230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec87b2-23e0-4c20-a78d-bf444aab120e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:05.890417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec87b2-23e0-4c20-a78d-bf444aab120e None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:05.891581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec87b2-23e0-4c20-a78d-bf444aab120e None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:05.893071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec87b2-23e0-4c20-a78d-bf444aab120e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:05.894704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 68/134] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:05 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:05.909369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec87b2-23e0-4c20-a78d-bf444aab120e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:06.023916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:06.072029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec87b2-23e0-4c20-a78d-bf444aab120e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:06.117643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b00a4d-55ac-4e7d-91cd-8674e984cc91 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:06.130698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c728511-4b7b-44cf-84ee-4ab8082cdf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:06.136015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728511-4b7b-44cf-84ee-4ab8082cdf8e None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:06.136015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728511-4b7b-44cf-84ee-4ab8082cdf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:06.136015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c728511-4b7b-44cf-84ee-4ab8082cdf8e None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966/users/fd0e69577dc04c68968f75a91a2c3aaf/roles/ca65b374d43c43aabe987aabb7147e99` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:06.136015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728511-4b7b-44cf-84ee-4ab8082cdf8e None admin] RBAC: Authorizing `identity:create_grant(project_id=16145402c02e4b02a32a9d3478528966, user_id=fd0e69577dc04c68968f75a91a2c3aaf, role_id=ca65b374d43c43aabe987aabb7147e99)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:06.136789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c728511-4b7b-44cf-84ee-4ab8082cdf8e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:06.171997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c121a15-92ee-4138-9325-271c507940d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:06.173022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121a15-92ee-4138-9325-271c507940d7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:06.173551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121a15-92ee-4138-9325-271c507940d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:06.174020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121a15-92ee-4138-9325-271c507940d7 None admin] PATH_INFO: `/v3/projects/231ee93a1f944a35b1b5aedffbf8ba62` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:06.175406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c121a15-92ee-4138-9325-271c507940d7 None admin] RBAC: Authorizing `identity:get_project(project_id=231ee93a1f944a35b1b5aedffbf8ba62)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:06.177146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c121a15-92ee-4138-9325-271c507940d7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:06.178976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 67/135] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:05 2022] GET /identity/v3/projects/231ee93a1f944a35b1b5aedffbf8ba62 => generated 312 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:06.180392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9c04-ff96-44f3-a1a2-a6d90b713641 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:06.180875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9c04-ff96-44f3-a1a2-a6d90b713641 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:06.181361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a9c04-ff96-44f3-a1a2-a6d90b713641 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:06.183084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 68/136] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:06.188157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a9c04-ff96-44f3-a1a2-a6d90b713641 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:06.220447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:06.248867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 69/137] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:05 2022] PUT /identity/v3/projects/16145402c02e4b02a32a9d3478528966/users/fd0e69577dc04c68968f75a91a2c3aaf/roles/ca65b374d43c43aabe987aabb7147e99 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:06.250442 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a20ee-c05a-4d01-86a2-751cd2b07184 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:06.250960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a20ee-c05a-4d01-86a2-751cd2b07184 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:06.251430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a20ee-c05a-4d01-86a2-751cd2b07184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:06.294237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c73a20ee-c05a-4d01-86a2-751cd2b07184 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:06.295883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c73a20ee-c05a-4d01-86a2-751cd2b07184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:06.296640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a9c04-ff96-44f3-a1a2-a6d90b713641 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:06.333759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d913312-272b-4806-aa71-3ab9090857e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:06.334437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d913312-272b-4806-aa71-3ab9090857e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:06.334720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d913312-272b-4806-aa71-3ab9090857e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:06.334997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d913312-272b-4806-aa71-3ab9090857e9 None admin] PATH_INFO: `/v3/projects/231ee93a1f944a35b1b5aedffbf8ba62/users/fd0e69577dc04c68968f75a91a2c3aaf/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:06.337243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d913312-272b-4806-aa71-3ab9090857e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=231ee93a1f944a35b1b5aedffbf8ba62, user_id=fd0e69577dc04c68968f75a91a2c3aaf, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:06.338732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d913312-272b-4806-aa71-3ab9090857e9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:06.400643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 70/138] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:06.413608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 69/139] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:06 2022] PUT /identity/v3/projects/231ee93a1f944a35b1b5aedffbf8ba62/users/fd0e69577dc04c68968f75a91a2c3aaf/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:06.780983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a20ee-c05a-4d01-86a2-751cd2b07184 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:06.852100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:06.924036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a20ee-c05a-4d01-86a2-751cd2b07184 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:06.969462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a758298-82fa-4780-af24-92d871baf0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:06.970114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758298-82fa-4780-af24-92d871baf0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:06.970403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758298-82fa-4780-af24-92d871baf0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:06.970682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a758298-82fa-4780-af24-92d871baf0b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:06.971812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a758298-82fa-4780-af24-92d871baf0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:06.973321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a758298-82fa-4780-af24-92d871baf0b2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:06.974907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 71/140] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:06.981220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d913312-272b-4806-aa71-3ab9090857e9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:07.101984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:07.101984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d913312-272b-4806-aa71-3ab9090857e9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:07.139048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410ca0a-bc9f-49ad-8486-dc26f432bd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:07.139665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ca0a-bc9f-49ad-8486-dc26f432bd1e None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:07.139947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ca0a-bc9f-49ad-8486-dc26f432bd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:07.140531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410ca0a-bc9f-49ad-8486-dc26f432bd1e None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:07.141245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410ca0a-bc9f-49ad-8486-dc26f432bd1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:07.142864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410ca0a-bc9f-49ad-8486-dc26f432bd1e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:07.184080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99bf08-a7e5-4225-8ca3-eff60ee71912 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:07.184459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99bf08-a7e5-4225-8ca3-eff60ee71912 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:07.184695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99bf08-a7e5-4225-8ca3-eff60ee71912 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:07.186063 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 72/141] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:07.191389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7237-c53e-4351-89ab-5102be1b8a90 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:07.191679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7237-c53e-4351-89ab-5102be1b8a90 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:07.191967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b7237-c53e-4351-89ab-5102be1b8a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:07.221675 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f88b7237-c53e-4351-89ab-5102be1b8a90 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:07.222814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f88b7237-c53e-4351-89ab-5102be1b8a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:07.232157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 70/142] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:06 2022] POST /identity/v3/users => generated 283 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:07.328727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 73/143] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:07.747308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7da0e-bb45-4da2-bb60-774733689a28 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:07.747808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7da0e-bb45-4da2-bb60-774733689a28 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:07.747910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7da0e-bb45-4da2-bb60-774733689a28 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:07.749241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 71/144] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:07.754684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a676-7212-4196-8cf4-0c885599b905 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:07.755098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a676-7212-4196-8cf4-0c885599b905 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:07.755263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a676-7212-4196-8cf4-0c885599b905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:07.774273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9830a676-7212-4196-8cf4-0c885599b905 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:07.775502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9830a676-7212-4196-8cf4-0c885599b905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:07.829422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:07.857007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 74/145] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:07.904399 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7da0e-bb45-4da2-bb60-774733689a28 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.025765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7da0e-bb45-4da2-bb60-774733689a28 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:08.064450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493fad5-0bee-4c08-8d13-82830b6d4b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:08.065096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493fad5-0bee-4c08-8d13-82830b6d4b45 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:08.065378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493fad5-0bee-4c08-8d13-82830b6d4b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:08.065653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493fad5-0bee-4c08-8d13-82830b6d4b45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:08.078078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493fad5-0bee-4c08-8d13-82830b6d4b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c493fad5-0bee-4c08-8d13-82830b6d4b45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:08.083113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:08.083967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:08.084779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 72/146] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:08.090120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830a676-7212-4196-8cf4-0c885599b905 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.216880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830a676-7212-4196-8cf4-0c885599b905 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:08.223027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493fad5-0bee-4c08-8d13-82830b6d4b45 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.236409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:08.274816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:08.275722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:08.276054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:08.276284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:08.277165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:08.277477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:08.281249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:08.300593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 75/147] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:08.306041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.359543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:08.397072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493fad5-0bee-4c08-8d13-82830b6d4b45 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:08.451999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841bdda-0652-4000-9788-84d41abdb050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:08.452675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841bdda-0652-4000-9788-84d41abdb050 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:08.452980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841bdda-0652-4000-9788-84d41abdb050 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:08.456844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841bdda-0652-4000-9788-84d41abdb050 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:08.459687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529d2e9-8b48-4fff-8ede-b2753771476e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:08.477526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841bdda-0652-4000-9788-84d41abdb050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6841bdda-0652-4000-9788-84d41abdb050 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:08.483262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:08.485300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:08.487271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 73/148] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:06:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:06:08.496356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841bdda-0652-4000-9788-84d41abdb050 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.530524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020f64d-ed7c-4e2a-af12-20b1c00b6197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:08.531099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f64d-ed7c-4e2a-af12-20b1c00b6197 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:08.531387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f64d-ed7c-4e2a-af12-20b1c00b6197 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:08.531674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f64d-ed7c-4e2a-af12-20b1c00b6197 None admin] PATH_INFO: `/v3/users/6d9e3decbbcf41b493adb5f2997ffd79` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:08.532958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020f64d-ed7c-4e2a-af12-20b1c00b6197 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9e3decbbcf41b493adb5f2997ffd79)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:08.534410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020f64d-ed7c-4e2a-af12-20b1c00b6197 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:08.536314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 76/149] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:08 2022] GET /identity/v3/users/6d9e3decbbcf41b493adb5f2997ffd79 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:08.541885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020f64d-ed7c-4e2a-af12-20b1c00b6197 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.597329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:08.651057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841bdda-0652-4000-9788-84d41abdb050 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:08.703277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:08.704040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:08.704341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:08.704618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:08.705300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:08.705598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:08.707093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:08.716427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 74/150] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:08.722616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.725568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020f64d-ed7c-4e2a-af12-20b1c00b6197 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:08.742072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:08.794858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10afd4-50d6-48d4-b57e-45943049f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:08.795579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10afd4-50d6-48d4-b57e-45943049f7fd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:08.795749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10afd4-50d6-48d4-b57e-45943049f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:08.795979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10afd4-50d6-48d4-b57e-45943049f7fd None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:08.797177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10afd4-50d6-48d4-b57e-45943049f7fd None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:08.798659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10afd4-50d6-48d4-b57e-45943049f7fd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:08.804420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 77/151] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:08 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:08.806072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10afd4-50d6-48d4-b57e-45943049f7fd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.866764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b4b4c-d101-46ea-a8ff-368b62be8133 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:08.916671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:08.924545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14924986-659d-482c-9bdd-70566df78dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:08.928029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14924986-659d-482c-9bdd-70566df78dfb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:08.928029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14924986-659d-482c-9bdd-70566df78dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:08.928029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14924986-659d-482c-9bdd-70566df78dfb None admin] PATH_INFO: `/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:08.928029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14924986-659d-482c-9bdd-70566df78dfb None admin] RBAC: Authorizing `identity:get_user(user_id=41f4ecddb8d24b6f9cf0196547a5fb33)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:08.929413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14924986-659d-482c-9bdd-70566df78dfb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:08.931539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 75/152] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:08 2022] GET /identity/v3/users/41f4ecddb8d24b6f9cf0196547a5fb33 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:08.937755 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14924986-659d-482c-9bdd-70566df78dfb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:08.954112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10afd4-50d6-48d4-b57e-45943049f7fd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:08.991220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6d9eb-0add-401d-b35a-7bb75f204b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:08.991896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6d9eb-0add-401d-b35a-7bb75f204b55 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:08.992179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6d9eb-0add-401d-b35a-7bb75f204b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:08.992479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6d9eb-0add-401d-b35a-7bb75f204b55 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966/users/6d9e3decbbcf41b493adb5f2997ffd79/roles/96c3f321e7a94ce88e601331d741c325` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:08.994452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6d9eb-0add-401d-b35a-7bb75f204b55 None admin] RBAC: Authorizing `identity:create_grant(project_id=16145402c02e4b02a32a9d3478528966, user_id=6d9e3decbbcf41b493adb5f2997ffd79, role_id=96c3f321e7a94ce88e601331d741c325)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:08.996472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6d9eb-0add-401d-b35a-7bb75f204b55 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:09.073718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 78/153] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:08 2022] PUT /identity/v3/projects/16145402c02e4b02a32a9d3478528966/users/6d9e3decbbcf41b493adb5f2997ffd79/roles/96c3f321e7a94ce88e601331d741c325 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:09.096334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14924986-659d-482c-9bdd-70566df78dfb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:09.102179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08314e-0c15-4048-b374-7dc7d65bbd77 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.102473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08314e-0c15-4048-b374-7dc7d65bbd77 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.102742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08314e-0c15-4048-b374-7dc7d65bbd77 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:09.104515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 79/154] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:09.113728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5931e6c-dd33-4d7a-b4c4-312bee24a4b8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.114014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5931e6c-dd33-4d7a-b4c4-312bee24a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.114341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5931e6c-dd33-4d7a-b4c4-312bee24a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:09.154866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d5931e6c-dd33-4d7a-b4c4-312bee24a4b8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:09.160572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d5931e6c-dd33-4d7a-b4c4-312bee24a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:09.185104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c6d9a-ac32-4ffa-b639-2467bdad9f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:09.186126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6d9a-ac32-4ffa-b639-2467bdad9f60 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.186616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6d9a-ac32-4ffa-b639-2467bdad9f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.187084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6d9a-ac32-4ffa-b639-2467bdad9f60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:09.209549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:09.263010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 80/155] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 10:06:09.345263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:09.348975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c6d9a-ac32-4ffa-b639-2467bdad9f60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:09.350483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c6d9a-ac32-4ffa-b639-2467bdad9f60 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:09.477424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 76/156] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:09.483562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5931e6c-dd33-4d7a-b4c4-312bee24a4b8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:09.573789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a243-f413-4aac-ba18-b76770939464 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.574407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a243-f413-4aac-ba18-b76770939464 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.574879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a243-f413-4aac-ba18-b76770939464 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:09.580910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 77/157] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:09.585941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7fa9f-0f61-48fc-b9c3-53dac4b8a6a1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.586460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7fa9f-0f61-48fc-b9c3-53dac4b8a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.586930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7fa9f-0f61-48fc-b9c3-53dac4b8a6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:09.613111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5931e6c-dd33-4d7a-b4c4-312bee24a4b8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:09.632175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9cd7fa9f-0f61-48fc-b9c3-53dac4b8a6a1 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:09.635442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9cd7fa9f-0f61-48fc-b9c3-53dac4b8a6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:09.661096 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1076aa-316a-48f3-a563-5f45439e804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:09.662388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1076aa-316a-48f3-a563-5f45439e804c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.662922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1076aa-316a-48f3-a563-5f45439e804c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.663565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1076aa-316a-48f3-a563-5f45439e804c None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:09.665255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1076aa-316a-48f3-a563-5f45439e804c None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:09.667145 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1076aa-316a-48f3-a563-5f45439e804c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:09.673692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 81/158] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:09 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:09.679481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1076aa-316a-48f3-a563-5f45439e804c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:09.756711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:09.769774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 78/159] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:09.770837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7fa9f-0f61-48fc-b9c3-53dac4b8a6a1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:09.820698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:09.848945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1076aa-316a-48f3-a563-5f45439e804c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:09.953992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42827-a0e8-49be-a633-682642756e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:09.954523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42827-a0e8-49be-a633-682642756e9d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.954804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42827-a0e8-49be-a633-682642756e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.955078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42827-a0e8-49be-a633-682642756e9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:09.955820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42827-a0e8-49be-a633-682642756e9d None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=16145402c02e4b02a32a9d3478528966, user.id=41f4ecddb8d24b6f9cf0196547a5fb33) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:09.956127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42827-a0e8-49be-a633-682642756e9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:09.957652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42827-a0e8-49be-a633-682642756e9d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:09.962310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7fa9f-0f61-48fc-b9c3-53dac4b8a6a1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:09.968941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 82/160] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:09 2022] GET /identity/v3/role_assignments?user.id=41f4ecddb8d24b6f9cf0196547a5fb33&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=fe95a036fa044c4bb408b793fba6436a => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:09.970182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0dfb0-0984-47c3-aa9b-d80a94104bae None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.970471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0dfb0-0984-47c3-aa9b-d80a94104bae None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.970743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0dfb0-0984-47c3-aa9b-d80a94104bae None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:09.972092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 83/161] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:09.977782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881dee-438b-48a2-a3d6-989499a77364 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:09.978082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881dee-438b-48a2-a3d6-989499a77364 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:09.978330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881dee-438b-48a2-a3d6-989499a77364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:10.017304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-09881dee-438b-48a2-a3d6-989499a77364 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:10.018566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-09881dee-438b-48a2-a3d6-989499a77364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:10.034523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b054e7-6188-49ef-b614-0321bbee0f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:10.035581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b054e7-6188-49ef-b614-0321bbee0f6c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:10.036033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b054e7-6188-49ef-b614-0321bbee0f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:10.036844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b054e7-6188-49ef-b614-0321bbee0f6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:10.059826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b054e7-6188-49ef-b614-0321bbee0f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-63b054e7-6188-49ef-b614-0321bbee0f6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:10.065643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:10.066593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:10.067386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:10.069529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 79/162] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:10.076008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b054e7-6188-49ef-b614-0321bbee0f6c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:10.142315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 84/163] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:10.225797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:10.243440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b054e7-6188-49ef-b614-0321bbee0f6c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:10.288997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:10.290107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:10.290559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:10.290973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:10.291796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:10.292969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:10.294617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:10.306994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 80/164] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:10.314564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881dee-438b-48a2-a3d6-989499a77364 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:10.361851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:10.447027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881dee-438b-48a2-a3d6-989499a77364 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:10.467526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:10.497095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03e987-a449-4290-9f8b-efbe3d1a78f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:10.497662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e987-a449-4290-9f8b-efbe3d1a78f7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:10.497965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e987-a449-4290-9f8b-efbe3d1a78f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:10.498692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03e987-a449-4290-9f8b-efbe3d1a78f7 None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:10.500175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03e987-a449-4290-9f8b-efbe3d1a78f7 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:10.502319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03e987-a449-4290-9f8b-efbe3d1a78f7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:10.503786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 85/165] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:10 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:10.509400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03e987-a449-4290-9f8b-efbe3d1a78f7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:10.622608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03e987-a449-4290-9f8b-efbe3d1a78f7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:10.632517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:10.660032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2efff7-5506-485a-87f6-1bc42c7b1c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:10.661072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2efff7-5506-485a-87f6-1bc42c7b1c1e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:10.661551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2efff7-5506-485a-87f6-1bc42c7b1c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:10.662017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2efff7-5506-485a-87f6-1bc42c7b1c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:10.702453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1488201-34eb-4f6b-aa29-b4287e6de508 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:10.738469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2efff7-5506-485a-87f6-1bc42c7b1c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:10.740318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2efff7-5506-485a-87f6-1bc42c7b1c1e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:10.765328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb3115-f0d3-417b-99c8-9b0828adbe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:10.765894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3115-f0d3-417b-99c8-9b0828adbe8c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:10.766173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3115-f0d3-417b-99c8-9b0828adbe8c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:10.766444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3115-f0d3-417b-99c8-9b0828adbe8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:10.788550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb3115-f0d3-417b-99c8-9b0828adbe8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b4cb3115-f0d3-417b-99c8-9b0828adbe8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:10.796263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:10.797256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 81/166] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:06:10.803135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb3115-f0d3-417b-99c8-9b0828adbe8c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:10.825798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:10.863419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 86/167] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 10:06:10.864000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:10.865151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2efff7-5506-485a-87f6-1bc42c7b1c1e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:10.972137 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2efff7-5506-485a-87f6-1bc42c7b1c1e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.008846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.009816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.010296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.011334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:11.012319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:11.012847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:11.014594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:11.024250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 87/168] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:11.029647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:11.050712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb3115-f0d3-417b-99c8-9b0828adbe8c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.106022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b3b9-3a3e-48a3-95d7-d9851ebc4a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.106717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b3b9-3a3e-48a3-95d7-d9851ebc4a4c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.107000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b3b9-3a3e-48a3-95d7-d9851ebc4a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.107345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b3b9-3a3e-48a3-95d7-d9851ebc4a4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:11.123651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:11.129019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b3b9-3a3e-48a3-95d7-d9851ebc4a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c0f9b3b9-3a3e-48a3-95d7-d9851ebc4a4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:11.134754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:11.136434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:11.137341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:11.141149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 82/169] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:11.142127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b3b9-3a3e-48a3-95d7-d9851ebc4a4c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:11.148811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf3ed0-21dc-42fc-9dbe-0275a2aa27de None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.188496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4731033-59d6-42e5-a9dd-aa5ec1e972ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.189488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731033-59d6-42e5-a9dd-aa5ec1e972ee None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.190060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731033-59d6-42e5-a9dd-aa5ec1e972ee None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.190531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731033-59d6-42e5-a9dd-aa5ec1e972ee None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:11.191880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4731033-59d6-42e5-a9dd-aa5ec1e972ee None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:11.193551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4731033-59d6-42e5-a9dd-aa5ec1e972ee None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:11.195414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 88/170] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:11 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:11.196724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4731033-59d6-42e5-a9dd-aa5ec1e972ee None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:11.242086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:11.283669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b3b9-3a3e-48a3-95d7-d9851ebc4a4c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.317684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4731033-59d6-42e5-a9dd-aa5ec1e972ee None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.329531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4946e91-32cf-4cc0-ad59-dcbfcadd3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.329873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4946e91-32cf-4cc0-ad59-dcbfcadd3006 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.330157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4946e91-32cf-4cc0-ad59-dcbfcadd3006 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.330436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4946e91-32cf-4cc0-ad59-dcbfcadd3006 None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:11.331602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4946e91-32cf-4cc0-ad59-dcbfcadd3006 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:11.333106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4946e91-32cf-4cc0-ad59-dcbfcadd3006 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:11.339553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 83/171] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:11 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:11.339553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4946e91-32cf-4cc0-ad59-dcbfcadd3006 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:11.359621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:11.369478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.371177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.371562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.378931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:11.378931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:11.378931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:11.378931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:11.387926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 89/172] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:11.388929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:11.470225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4946e91-32cf-4cc0-ad59-dcbfcadd3006 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.508225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.509054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.509463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.509836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:11.510709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] RBAC: Adding query filter params (role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=16145402c02e4b02a32a9d3478528966, user.id=fd0e69577dc04c68968f75a91a2c3aaf) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:11.511954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:11.513343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:11.519698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 84/173] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:11 2022] GET /identity/v3/role_assignments?user.id=fd0e69577dc04c68968f75a91a2c3aaf&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:11.520559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:11.523816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:11.528893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4636822-8ac4-4452-92a2-d964edc0afeb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.581194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f68c0-5172-4770-9f71-b75dd11761c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.582661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f68c0-5172-4770-9f71-b75dd11761c1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.583115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f68c0-5172-4770-9f71-b75dd11761c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.583532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f68c0-5172-4770-9f71-b75dd11761c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:11.647428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10872a4-531c-4536-96cf-9395e1749aa3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.663663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:11.676463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f68c0-5172-4770-9f71-b75dd11761c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:11.678149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f68c0-5172-4770-9f71-b75dd11761c1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:11.696114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12cac8-2e37-445e-b410-1223016001f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.697402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12cac8-2e37-445e-b410-1223016001f1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.697923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12cac8-2e37-445e-b410-1223016001f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.698857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12cac8-2e37-445e-b410-1223016001f1 None admin] PATH_INFO: `/v3/users/fd0e69577dc04c68968f75a91a2c3aaf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:11.700549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12cac8-2e37-445e-b410-1223016001f1 None admin] RBAC: Authorizing `identity:get_user(user_id=fd0e69577dc04c68968f75a91a2c3aaf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:11.702550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12cac8-2e37-445e-b410-1223016001f1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:11.704924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 85/174] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:11 2022] GET /identity/v3/users/fd0e69577dc04c68968f75a91a2c3aaf => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:11.711004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12cac8-2e37-445e-b410-1223016001f1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:11.847482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:11.858137 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 90/175] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:11.864950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f68c0-5172-4770-9f71-b75dd11761c1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:11.906717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12cac8-2e37-445e-b410-1223016001f1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:11.960933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5450-5c11-421f-9ad6-35ebde6a5f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:11.961824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5450-5c11-421f-9ad6-35ebde6a5f02 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:11.962110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5450-5c11-421f-9ad6-35ebde6a5f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:11.962536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5450-5c11-421f-9ad6-35ebde6a5f02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.041602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:12.046552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b5450-5c11-421f-9ad6-35ebde6a5f02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:12.048394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b5450-5c11-421f-9ad6-35ebde6a5f02 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:12.067113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f68c0-5172-4770-9f71-b75dd11761c1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:12.136667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:12.143981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23ac44-4833-4069-90e7-d3ee30071ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:12.144657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ac44-4833-4069-90e7-d3ee30071ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.144939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ac44-4833-4069-90e7-d3ee30071ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.145243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23ac44-4833-4069-90e7-d3ee30071ec9 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.146386 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23ac44-4833-4069-90e7-d3ee30071ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:12.147841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23ac44-4833-4069-90e7-d3ee30071ec9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:12.149510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 91/176] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:11 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:12.156264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b67c44-839f-487f-904c-c4cf04292a6a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.156592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b67c44-839f-487f-904c-c4cf04292a6a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.156872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b67c44-839f-487f-904c-c4cf04292a6a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.158461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 92/177] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:12.164024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64edc-17ad-4295-94f6-dd8cb41b6ef5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.164320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64edc-17ad-4295-94f6-dd8cb41b6ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.164606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64edc-17ad-4295-94f6-dd8cb41b6ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.181000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 86/178] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 10:06:12.181948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5450-5c11-421f-9ad6-35ebde6a5f02 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:12.201348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f3b64edc-17ad-4295-94f6-dd8cb41b6ef5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:12.202557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f3b64edc-17ad-4295-94f6-dd8cb41b6ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:12.343530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 93/179] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:12.344531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64edc-17ad-4295-94f6-dd8cb41b6ef5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:12.366362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5450-5c11-421f-9ad6-35ebde6a5f02 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:12.456608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:12.471590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64edc-17ad-4295-94f6-dd8cb41b6ef5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:12.479607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:12.479607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.479607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.479607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.480078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] RBAC: Adding query filter params (role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=16145402c02e4b02a32a9d3478528966, user.id=fd0e69577dc04c68968f75a91a2c3aaf) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:12.480078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:12.480963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:12.502397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 87/180] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:12 2022] GET /identity/v3/role_assignments?user.id=fd0e69577dc04c68968f75a91a2c3aaf&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:12.509346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b03e3-948b-4556-8006-9f63e30692a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:12.510002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b03e3-948b-4556-8006-9f63e30692a1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.510283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b03e3-948b-4556-8006-9f63e30692a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.510563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b03e3-948b-4556-8006-9f63e30692a1 None admin] PATH_INFO: `/v3/projects/231ee93a1f944a35b1b5aedffbf8ba62` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.512412 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b03e3-948b-4556-8006-9f63e30692a1 None admin] RBAC: Authorizing `identity:get_project(project_id=231ee93a1f944a35b1b5aedffbf8ba62)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:12.514036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92b03e3-948b-4556-8006-9f63e30692a1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:12.515832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 94/181] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:12 2022] GET /identity/v3/projects/231ee93a1f944a35b1b5aedffbf8ba62 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:12.522512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:12.561917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:12.628127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcdd93-820f-4b3f-9c62-e9b4502b559d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.673090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcdd93-820f-4b3f-9c62-e9b4502b559d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.673090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcdd93-820f-4b3f-9c62-e9b4502b559d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.673090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 95/182] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:12.673090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c35fa5-5495-4d1d-9506-d1592bb498bd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.673090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c35fa5-5495-4d1d-9506-d1592bb498bd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.673090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c35fa5-5495-4d1d-9506-d1592bb498bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.673887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e4e08-4b28-4724-88be-37bc80b7820b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:12.679404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-32c35fa5-5495-4d1d-9506-d1592bb498bd None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:12.680938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-32c35fa5-5495-4d1d-9506-d1592bb498bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:12.759708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:12.760245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.760557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.761046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.761801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] RBAC: Adding query filter params (role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=231ee93a1f944a35b1b5aedffbf8ba62, user.id=fd0e69577dc04c68968f75a91a2c3aaf) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:12.762106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:12.763570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:12.781056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 96/183] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:12.782901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 88/184] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:12 2022] GET /identity/v3/role_assignments?user.id=fd0e69577dc04c68968f75a91a2c3aaf&scope.project.id=231ee93a1f944a35b1b5aedffbf8ba62&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:12.797962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe9ec-4478-4a7c-af18-06170da2704e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.798321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe9ec-4478-4a7c-af18-06170da2704e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.798519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe9ec-4478-4a7c-af18-06170da2704e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.800038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 97/185] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:12.801813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:12.806613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b03a-9b4f-40fd-b3c5-8650cf9c5338 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.806913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b03a-9b4f-40fd-b3c5-8650cf9c5338 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.808572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17b03a-9b4f-40fd-b3c5-8650cf9c5338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.831860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ad17b03a-9b4f-40fd-b3c5-8650cf9c5338 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:12.833166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad17b03a-9b4f-40fd-b3c5-8650cf9c5338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:12.924766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 98/186] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:12.926868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f40fa-4c0d-45c7-97ce-142c70704200 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.927368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f40fa-4c0d-45c7-97ce-142c70704200 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.927852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f40fa-4c0d-45c7-97ce-142c70704200 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.929478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 99/187] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:12.938957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:12.940791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c97a5-55cb-4ff5-995d-b5fc2f9efec8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.941302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c97a5-55cb-4ff5-995d-b5fc2f9efec8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.941786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c97a5-55cb-4ff5-995d-b5fc2f9efec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.943157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba2c1a-c72a-4927-a9c6-963dadf4d193 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:12.983463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8bf7d-cbe1-421b-be60-5e2c1d57b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:12.984097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bf7d-cbe1-421b-be60-5e2c1d57b0ec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:12.984402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bf7d-cbe1-421b-be60-5e2c1d57b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:12.984732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8bf7d-cbe1-421b-be60-5e2c1d57b0ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:12.989286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-009c97a5-55cb-4ff5-995d-b5fc2f9efec8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:12.990750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-009c97a5-55cb-4ff5-995d-b5fc2f9efec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:12.995915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8bf7d-cbe1-421b-be60-5e2c1d57b0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-99f8bf7d-cbe1-421b-be60-5e2c1d57b0ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:13.002625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:13.003586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:13.004460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 89/188] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:13.012404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.017371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8bf7d-cbe1-421b-be60-5e2c1d57b0ec None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.081423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 100/189] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:13.115207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c97a5-55cb-4ff5-995d-b5fc2f9efec8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.132462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8bf7d-cbe1-421b-be60-5e2c1d57b0ec None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.170418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.171057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.171057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.171057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.171711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:13.172024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:13.173669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:13.183552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 90/190] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:13.196571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.233049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.234249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c97a5-55cb-4ff5-995d-b5fc2f9efec8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.270597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903acd1-e28d-4f05-b17e-26e5446b098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.271472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903acd1-e28d-4f05-b17e-26e5446b098a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.271908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903acd1-e28d-4f05-b17e-26e5446b098a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.272377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903acd1-e28d-4f05-b17e-26e5446b098a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.284022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903acd1-e28d-4f05-b17e-26e5446b098a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3903acd1-e28d-4f05-b17e-26e5446b098a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:13.289202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:13.290561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:13.291581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:13.294465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 101/191] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:06:13.295400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903acd1-e28d-4f05-b17e-26e5446b098a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.311769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.318523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde168ab-ea8d-4feb-ace7-b7cf8c96e53d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.357199 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054eeb9-766c-40b5-8967-f0375c001faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.357835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054eeb9-766c-40b5-8967-f0375c001faa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.358110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054eeb9-766c-40b5-8967-f0375c001faa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.358381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054eeb9-766c-40b5-8967-f0375c001faa None admin] PATH_INFO: `/v3/users/5e7d08612f354561b5c296287bafb4c6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.372408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054eeb9-766c-40b5-8967-f0375c001faa None admin] RBAC: Authorizing `identity:get_user(user_id=5e7d08612f354561b5c296287bafb4c6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:13.373873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054eeb9-766c-40b5-8967-f0375c001faa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:13.375657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 91/192] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/users/5e7d08612f354561b5c296287bafb4c6 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:13.376248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054eeb9-766c-40b5-8967-f0375c001faa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.406486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903acd1-e28d-4f05-b17e-26e5446b098a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.441182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc241b-f439-44dd-bd6d-919f2897e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.442005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc241b-f439-44dd-bd6d-919f2897e020 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.442290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc241b-f439-44dd-bd6d-919f2897e020 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.442558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc241b-f439-44dd-bd6d-919f2897e020 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.452582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc241b-f439-44dd-bd6d-919f2897e020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:13.454032 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7ffc241b-f439-44dd-bd6d-919f2897e020 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:13.457356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:13.458267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:13.459070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 102/193] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:13.459732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc241b-f439-44dd-bd6d-919f2897e020 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.478492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054eeb9-766c-40b5-8967-f0375c001faa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.513264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.513877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.514159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.514434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.515108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:13.515414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:13.516848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:13.523539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.524651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 92/194] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:13.525438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.563001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc241b-f439-44dd-bd6d-919f2897e020 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.597099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237807-37fd-4829-8874-90fd2cc3c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.597700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237807-37fd-4829-8874-90fd2cc3c090 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.597981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237807-37fd-4829-8874-90fd2cc3c090 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.598253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237807-37fd-4829-8874-90fd2cc3c090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.623356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dea60-f987-4f0c-9f03-b6e44cd6a85e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.655695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1276e5-0f5f-46e9-ab9e-e05210c6aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.656433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1276e5-0f5f-46e9-ab9e-e05210c6aae2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.656710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1276e5-0f5f-46e9-ab9e-e05210c6aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.656979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1276e5-0f5f-46e9-ab9e-e05210c6aae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.658078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1276e5-0f5f-46e9-ab9e-e05210c6aae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:13.659513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1276e5-0f5f-46e9-ab9e-e05210c6aae2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:13.661257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 93/195] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:13.661836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1276e5-0f5f-46e9-ab9e-e05210c6aae2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.667598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d237807-37fd-4829-8874-90fd2cc3c090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:13.669113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d237807-37fd-4829-8874-90fd2cc3c090 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:13.673286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.732359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.759882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1276e5-0f5f-46e9-ab9e-e05210c6aae2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.767973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 103/196] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:13.768867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237807-37fd-4829-8874-90fd2cc3c090 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.794063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.794598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.794873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.795149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.795812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:13.796112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:13.797534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:13.805315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 94/197] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:13.805315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.871569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237807-37fd-4829-8874-90fd2cc3c090 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.880312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.904349 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e76d9-f989-4028-a78c-6c19ae5d965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.904976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e76d9-f989-4028-a78c-6c19ae5d965f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.905263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e76d9-f989-4028-a78c-6c19ae5d965f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.905534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e76d9-f989-4028-a78c-6c19ae5d965f None admin] PATH_INFO: `/v3/users/5e7d08612f354561b5c296287bafb4c6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.906660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e76d9-f989-4028-a78c-6c19ae5d965f None admin] RBAC: Authorizing `identity:get_user(user_id=5e7d08612f354561b5c296287bafb4c6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:13.908116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e76d9-f989-4028-a78c-6c19ae5d965f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:13.909720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 104/198] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/users/5e7d08612f354561b5c296287bafb4c6 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:13.910476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e76d9-f989-4028-a78c-6c19ae5d965f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:13.911160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836d3df-083a-472a-b91f-83076e8e1cbe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:13.944646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:13.948586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2451430-a5e5-4582-9c94-d86c0fc63dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:13.949234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451430-a5e5-4582-9c94-d86c0fc63dde None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:13.949514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451430-a5e5-4582-9c94-d86c0fc63dde None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:13.949783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451430-a5e5-4582-9c94-d86c0fc63dde None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:13.950839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2451430-a5e5-4582-9c94-d86c0fc63dde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:13.951865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2451430-a5e5-4582-9c94-d86c0fc63dde None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:14.009706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e76d9-f989-4028-a78c-6c19ae5d965f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:14.043096 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad17f72-226c-4691-b1d4-a83d6c9dbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:14.043911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17f72-226c-4691-b1d4-a83d6c9dbe9a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:14.044243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17f72-226c-4691-b1d4-a83d6c9dbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:14.044500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad17f72-226c-4691-b1d4-a83d6c9dbe9a None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:14.045632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad17f72-226c-4691-b1d4-a83d6c9dbe9a None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:14.047059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad17f72-226c-4691-b1d4-a83d6c9dbe9a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:14.048753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 105/199] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:13 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:14.049507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad17f72-226c-4691-b1d4-a83d6c9dbe9a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:14.092356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 95/200] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:13 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:14.092356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2451430-a5e5-4582-9c94-d86c0fc63dde None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:14.159781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad17f72-226c-4691-b1d4-a83d6c9dbe9a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:14.161563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:14.205561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2451430-a5e5-4582-9c94-d86c0fc63dde None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:14.206120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01a399-8f6b-4ddd-94db-03c00f53d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:14.206574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01a399-8f6b-4ddd-94db-03c00f53d144 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:14.206854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01a399-8f6b-4ddd-94db-03c00f53d144 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:14.207238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01a399-8f6b-4ddd-94db-03c00f53d144 None admin] PATH_INFO: `/v3/users/6d9e3decbbcf41b493adb5f2997ffd79` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:14.208794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01a399-8f6b-4ddd-94db-03c00f53d144 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9e3decbbcf41b493adb5f2997ffd79)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:14.209824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01a399-8f6b-4ddd-94db-03c00f53d144 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:14.216786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 106/201] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:14 2022] GET /identity/v3/users/6d9e3decbbcf41b493adb5f2997ffd79 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:14.218315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01a399-8f6b-4ddd-94db-03c00f53d144 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:14.235366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:14.248654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9491-e144-4300-a313-943bbe25cd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:14.249332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9491-e144-4300-a313-943bbe25cd63 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:14.249616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9491-e144-4300-a313-943bbe25cd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:14.249889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9491-e144-4300-a313-943bbe25cd63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:14.333943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9491-e144-4300-a313-943bbe25cd63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:14.334609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9491-e144-4300-a313-943bbe25cd63 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:14.346875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01a399-8f6b-4ddd-94db-03c00f53d144 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:14.399853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:14.401053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:14.401053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:14.401806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:14.402646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=c9222a29dae64be382f46397d59deaed, user.id=5e7d08612f354561b5c296287bafb4c6) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:14.402775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:14.404241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:14.410910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 107/202] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:14 2022] GET /identity/v3/role_assignments?user.id=5e7d08612f354561b5c296287bafb4c6&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=fe95a036fa044c4bb408b793fba6436a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:14.411525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:14.459251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:14.469097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 96/203] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:14.477386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9491-e144-4300-a313-943bbe25cd63 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:14.532504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:14.611008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e4b45-51a5-43c9-9935-95f3376ba851 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:14.639254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9491-e144-4300-a313-943bbe25cd63 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:14.660589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d58b8-75ee-40d2-9167-7d6c2e0d2152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:14.661532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d58b8-75ee-40d2-9167-7d6c2e0d2152 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:14.662551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d58b8-75ee-40d2-9167-7d6c2e0d2152 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:14.663051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d58b8-75ee-40d2-9167-7d6c2e0d2152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:14.698302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7823-af4c-49d6-b168-53c1d267585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:14.699213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7823-af4c-49d6-b168-53c1d267585b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:14.699490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7823-af4c-49d6-b168-53c1d267585b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:14.699757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad7823-af4c-49d6-b168-53c1d267585b None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:14.701431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad7823-af4c-49d6-b168-53c1d267585b None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:14.703391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad7823-af4c-49d6-b168-53c1d267585b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:14.709527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 97/204] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:14 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:14.718413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7823-af4c-49d6-b168-53c1d267585b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:14.805470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d58b8-75ee-40d2-9167-7d6c2e0d2152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:14.806841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d58b8-75ee-40d2-9167-7d6c2e0d2152 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:14.822098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:14.829666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad7823-af4c-49d6-b168-53c1d267585b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:14.867867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:14.868864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:14.869337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:14.869868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:14.871702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] RBAC: Adding query filter params (role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=c9222a29dae64be382f46397d59deaed, user.id=5e7d08612f354561b5c296287bafb4c6) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:14.872207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:14.873905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:14.880072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 98/205] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:14 2022] GET /identity/v3/role_assignments?user.id=5e7d08612f354561b5c296287bafb4c6&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:14.887778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:15.002225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 108/206] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:15.008069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:15.126137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc821c-b2b2-4c1f-97a5-785b00dc7976 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:15.205431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c61413-2dab-4336-a9d7-72eecd1932b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:15.206071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c61413-2dab-4336-a9d7-72eecd1932b7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:15.206585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c61413-2dab-4336-a9d7-72eecd1932b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:15.206585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c61413-2dab-4336-a9d7-72eecd1932b7 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:15.207710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c61413-2dab-4336-a9d7-72eecd1932b7 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:15.209255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c61413-2dab-4336-a9d7-72eecd1932b7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:15.210877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 99/207] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:15 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:15.217842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d58b8-75ee-40d2-9167-7d6c2e0d2152 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:15.369011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d58b8-75ee-40d2-9167-7d6c2e0d2152 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:15.422618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73845ac7-5aac-4ea2-9347-35fea912c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:15.423166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845ac7-5aac-4ea2-9347-35fea912c389 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:15.423452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845ac7-5aac-4ea2-9347-35fea912c389 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:15.423729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73845ac7-5aac-4ea2-9347-35fea912c389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:15.424500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73845ac7-5aac-4ea2-9347-35fea912c389 None admin] RBAC: Adding query filter params (role.id=96c3f321e7a94ce88e601331d741c325, scope.project.id=16145402c02e4b02a32a9d3478528966, user.id=6d9e3decbbcf41b493adb5f2997ffd79) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:15.424815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73845ac7-5aac-4ea2-9347-35fea912c389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:15.426268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73845ac7-5aac-4ea2-9347-35fea912c389 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:15.428372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:15.437267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 109/208] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:15 2022] GET /identity/v3/role_assignments?user.id=6d9e3decbbcf41b493adb5f2997ffd79&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=96c3f321e7a94ce88e601331d741c325 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:16.316267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279a6b-58c1-4005-894b-b0f29d960b5f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:16.316836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279a6b-58c1-4005-894b-b0f29d960b5f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:16.316836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279a6b-58c1-4005-894b-b0f29d960b5f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:16.318322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 100/209] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:16.323572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf3d8-4c6b-4729-8637-a69ad245e569 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:16.324056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf3d8-4c6b-4729-8637-a69ad245e569 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:16.324284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf3d8-4c6b-4729-8637-a69ad245e569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:16.342620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f21bf3d8-4c6b-4729-8637-a69ad245e569 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:16.343816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f21bf3d8-4c6b-4729-8637-a69ad245e569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:16.420410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 110/210] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:16.542562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188d42-0bae-4b69-97b5-859986a8a0d8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:16.542900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188d42-0bae-4b69-97b5-859986a8a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:16.543172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54188d42-0bae-4b69-97b5-859986a8a0d8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:16.544806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 101/211] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:16.550362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a649-861e-4559-a410-8a757716cc34 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:16.550650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a649-861e-4559-a410-8a757716cc34 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:16.550923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62a649-861e-4559-a410-8a757716cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:16.569297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5b62a649-861e-4559-a410-8a757716cc34 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:16.570402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5b62a649-861e-4559-a410-8a757716cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:16.587789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6bc3-ef50-47b9-905b-8b6bdb9384e7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:16.588075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6bc3-ef50-47b9-905b-8b6bdb9384e7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:16.588382 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6bc3-ef50-47b9-905b-8b6bdb9384e7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:16.590617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 102/212] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:16.595436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582472fa-bf5d-4f25-b716-6859e65e828b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:16.595724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582472fa-bf5d-4f25-b716-6859e65e828b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:16.596002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582472fa-bf5d-4f25-b716-6859e65e828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:16.614855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-582472fa-bf5d-4f25-b716-6859e65e828b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:16.616060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-582472fa-bf5d-4f25-b716-6859e65e828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:16.637809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:16.650007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 111/213] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:16.691205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 103/214] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:16.698287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a649-861e-4559-a410-8a757716cc34 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:16.758662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:16.804800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62a649-861e-4559-a410-8a757716cc34 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:16.840233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd24caa-994d-4f0f-8486-0e7d3d5b1ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:16.840997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd24caa-994d-4f0f-8486-0e7d3d5b1ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:16.841287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd24caa-994d-4f0f-8486-0e7d3d5b1ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:16.841570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd24caa-994d-4f0f-8486-0e7d3d5b1ec5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:16.851967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd24caa-994d-4f0f-8486-0e7d3d5b1ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3bd24caa-994d-4f0f-8486-0e7d3d5b1ec5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:16.857319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:16.858926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:16.860613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:16.863177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 112/215] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:16.864610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582472fa-bf5d-4f25-b716-6859e65e828b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:16.936513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd24caa-994d-4f0f-8486-0e7d3d5b1ec5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:16.973628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582472fa-bf5d-4f25-b716-6859e65e828b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.013319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.013943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.014225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.014497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.015177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:17.015485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:17.016918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:17.025734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 104/216] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:17.025734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.047258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:17.055043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd24caa-994d-4f0f-8486-0e7d3d5b1ec5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.077110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:17.097630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cc3ba-025d-4da4-b039-3c149701bb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.098514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc3ba-025d-4da4-b039-3c149701bb37 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.098798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc3ba-025d-4da4-b039-3c149701bb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.099073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cc3ba-025d-4da4-b039-3c149701bb37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.100869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cc3ba-025d-4da4-b039-3c149701bb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:17.102300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cc3ba-025d-4da4-b039-3c149701bb37 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:17.104064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 113/217] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:17.109847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cc3ba-025d-4da4-b039-3c149701bb37 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.135353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077379bc-693f-458d-9bf2-59d6b5076349 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.170153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4c218-5634-4441-bf70-3045ad2da844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.170785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4c218-5634-4441-bf70-3045ad2da844 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.171062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4c218-5634-4441-bf70-3045ad2da844 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.171328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4c218-5634-4441-bf70-3045ad2da844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.181293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4c218-5634-4441-bf70-3045ad2da844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-84d4c218-5634-4441-bf70-3045ad2da844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:17.186820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:17.187797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 105/218] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:06:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:17.188642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4c218-5634-4441-bf70-3045ad2da844 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.215477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cc3ba-025d-4da4-b039-3c149701bb37 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.248026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e674887-aa91-4a7b-a124-1d36f2fc3b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.248681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674887-aa91-4a7b-a124-1d36f2fc3b8c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.248967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674887-aa91-4a7b-a124-1d36f2fc3b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.249232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e674887-aa91-4a7b-a124-1d36f2fc3b8c None admin] PATH_INFO: `/v3/users/82830568253d48cbbacd5a2a41b3e77c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.264301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e674887-aa91-4a7b-a124-1d36f2fc3b8c None admin] RBAC: Authorizing `identity:get_user(user_id=82830568253d48cbbacd5a2a41b3e77c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:17.266065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:17.266190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e674887-aa91-4a7b-a124-1d36f2fc3b8c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:17.267905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 114/219] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:17 2022] GET /identity/v3/users/82830568253d48cbbacd5a2a41b3e77c => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:17.269118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5d69-7391-4ba9-9b32-61abe3034f25 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.269403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5d69-7391-4ba9-9b32-61abe3034f25 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.269678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b5d69-7391-4ba9-9b32-61abe3034f25 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.270877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 115/220] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:17.271565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5d69-7391-4ba9-9b32-61abe3034f25 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.291064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4c218-5634-4441-bf70-3045ad2da844 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.319608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:17.325647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207d209-951d-4cc6-a30f-d7d71eb295b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.326262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207d209-951d-4cc6-a30f-d7d71eb295b4 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.326542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207d209-951d-4cc6-a30f-d7d71eb295b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.326815 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207d209-951d-4cc6-a30f-d7d71eb295b4 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.327473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207d209-951d-4cc6-a30f-d7d71eb295b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:17.328973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207d209-951d-4cc6-a30f-d7d71eb295b4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:17.374169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b5d69-7391-4ba9-9b32-61abe3034f25 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.407507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304667-24f5-4436-8952-aaa701306594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.408102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304667-24f5-4436-8952-aaa701306594 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.408419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304667-24f5-4436-8952-aaa701306594 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.408691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304667-24f5-4436-8952-aaa701306594 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.409414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304667-24f5-4436-8952-aaa701306594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:17.409720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304667-24f5-4436-8952-aaa701306594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:17.411080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304667-24f5-4436-8952-aaa701306594 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:17.419933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 116/221] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:17.424190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304667-24f5-4436-8952-aaa701306594 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.450741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 106/222] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:17 2022] POST /identity/v3/users => generated 297 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:17.451985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a515f-fc79-454e-a0c0-07b16967900f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.452273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a515f-fc79-454e-a0c0-07b16967900f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.452590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a515f-fc79-454e-a0c0-07b16967900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.471568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c54a515f-fc79-454e-a0c0-07b16967900f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:17.472860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c54a515f-fc79-454e-a0c0-07b16967900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:17.530374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304667-24f5-4436-8952-aaa701306594 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.538170 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:17.547321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 107/223] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:17.548575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a515f-fc79-454e-a0c0-07b16967900f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.591752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7e624-388b-41b0-933b-b4f1acc65642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.593087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e624-388b-41b0-933b-b4f1acc65642 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.593648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e624-388b-41b0-933b-b4f1acc65642 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.594286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e624-388b-41b0-933b-b4f1acc65642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.647493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:17.688965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7e624-388b-41b0-933b-b4f1acc65642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:17.690728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7e624-388b-41b0-933b-b4f1acc65642 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:17.706770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a515f-fc79-454e-a0c0-07b16967900f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.758027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60701c8-20e9-4bb0-939b-b91754581afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.758708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60701c8-20e9-4bb0-939b-b91754581afc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.758989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60701c8-20e9-4bb0-939b-b91754581afc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.759263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60701c8-20e9-4bb0-939b-b91754581afc None admin] PATH_INFO: `/v3/users/5e7d08612f354561b5c296287bafb4c6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.761067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60701c8-20e9-4bb0-939b-b91754581afc None admin] RBAC: Authorizing `identity:get_user(user_id=5e7d08612f354561b5c296287bafb4c6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:17.762712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60701c8-20e9-4bb0-939b-b91754581afc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:17.764818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 108/224] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:17 2022] GET /identity/v3/users/5e7d08612f354561b5c296287bafb4c6 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:17.770447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60701c8-20e9-4bb0-939b-b91754581afc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.839722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 117/225] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:17.841943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7e624-388b-41b0-933b-b4f1acc65642 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.850440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:17.908671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60701c8-20e9-4bb0-939b-b91754581afc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:17.940018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:17.945157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4384f-302a-4163-ad59-3185bfe1c14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:17.946036 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4384f-302a-4163-ad59-3185bfe1c14b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:17.946178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4384f-302a-4163-ad59-3185bfe1c14b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:17.946462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4384f-302a-4163-ad59-3185bfe1c14b None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:17.947591 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4384f-302a-4163-ad59-3185bfe1c14b None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:17.949724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4384f-302a-4163-ad59-3185bfe1c14b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:17.951547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 109/226] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:17 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:17.952428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4384f-302a-4163-ad59-3185bfe1c14b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:17.963449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7e624-388b-41b0-933b-b4f1acc65642 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:18.001090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72cf0-804a-4f00-a773-329132ec33a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:18.001732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72cf0-804a-4f00-a773-329132ec33a0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:18.002117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72cf0-804a-4f00-a773-329132ec33a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:18.002400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72cf0-804a-4f00-a773-329132ec33a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:18.014357 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e72cf0-804a-4f00-a773-329132ec33a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c9e72cf0-804a-4f00-a773-329132ec33a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:18.020200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:18.021135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:18.021966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 118/227] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:18.022626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72cf0-804a-4f00-a773-329132ec33a0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:18.066306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4384f-302a-4163-ad59-3185bfe1c14b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:18.093291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:18.103610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8f55-75df-4b4a-933d-325dd3c97969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:18.104544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8f55-75df-4b4a-933d-325dd3c97969 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:18.105165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8f55-75df-4b4a-933d-325dd3c97969 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:18.105577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a8f55-75df-4b4a-933d-325dd3c97969 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:18.106885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a8f55-75df-4b4a-933d-325dd3c97969 None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:18.108538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a8f55-75df-4b4a-933d-325dd3c97969 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:18.110313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 110/228] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:17 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:18.111283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8f55-75df-4b4a-933d-325dd3c97969 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:18.135990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72cf0-804a-4f00-a773-329132ec33a0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:18.188942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:18.221919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a8f55-75df-4b4a-933d-325dd3c97969 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:18.255626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e75a4-5427-4614-8c37-0d84f4bd2966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:18.256258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e75a4-5427-4614-8c37-0d84f4bd2966 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:18.256569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e75a4-5427-4614-8c37-0d84f4bd2966 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:18.256843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e75a4-5427-4614-8c37-0d84f4bd2966 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed/users/5e7d08612f354561b5c296287bafb4c6/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:18.259018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e75a4-5427-4614-8c37-0d84f4bd2966 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9222a29dae64be382f46397d59deaed, user_id=5e7d08612f354561b5c296287bafb4c6, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:18.260685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e75a4-5427-4614-8c37-0d84f4bd2966 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:18.267015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:18.267626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:18.267902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:18.268171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:18.268866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:18.269164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:18.270533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:18.279348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 111/229] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:18.284343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:18.332777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 119/230] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:18 2022] PUT /identity/v3/projects/c9222a29dae64be382f46397d59deaed/users/5e7d08612f354561b5c296287bafb4c6/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:18.334880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e75a4-5427-4614-8c37-0d84f4bd2966 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:18.433317 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84711f-dc80-4266-ad29-dd6bee0a3fe7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:18.472699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e75a4-5427-4614-8c37-0d84f4bd2966 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:18.492339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:18.502043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:18.505437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:18.505437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:18.505437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:18.505437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] RBAC: Adding query filter params (role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=c9222a29dae64be382f46397d59deaed, user.id=82830568253d48cbbacd5a2a41b3e77c) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:18.505437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:18.505789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:18.508645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:18.512627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 112/231] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:18 2022] GET /identity/v3/role_assignments?user.id=82830568253d48cbbacd5a2a41b3e77c&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:18.519377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727842c-0d16-47be-9c61-251de5fc8a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:18.520439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727842c-0d16-47be-9c61-251de5fc8a77 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:18.520963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727842c-0d16-47be-9c61-251de5fc8a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:18.521501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727842c-0d16-47be-9c61-251de5fc8a77 None admin] PATH_INFO: `/v3/users/5e7d08612f354561b5c296287bafb4c6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:18.523055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727842c-0d16-47be-9c61-251de5fc8a77 None admin] RBAC: Authorizing `identity:get_user(user_id=5e7d08612f354561b5c296287bafb4c6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:18.524896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727842c-0d16-47be-9c61-251de5fc8a77 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:18.527073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 120/232] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:18 2022] GET /identity/v3/users/5e7d08612f354561b5c296287bafb4c6 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:18.532688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:18.646116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae23b08-8194-4047-8a79-2a4f752a8bc2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:18.684405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69758bb2-d815-487d-8dff-e056945bdae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:18.685441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69758bb2-d815-487d-8dff-e056945bdae8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:18.685917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69758bb2-d815-487d-8dff-e056945bdae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:18.686412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69758bb2-d815-487d-8dff-e056945bdae8 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:18.687778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69758bb2-d815-487d-8dff-e056945bdae8 None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:18.689535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69758bb2-d815-487d-8dff-e056945bdae8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:18.691729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 113/233] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:18 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:18.697259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727842c-0d16-47be-9c61-251de5fc8a77 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:18.865734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727842c-0d16-47be-9c61-251de5fc8a77 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:18.904886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388837d-f3c5-4126-a457-c06ffe292b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:18.905939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388837d-f3c5-4126-a457-c06ffe292b57 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:18.906422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388837d-f3c5-4126-a457-c06ffe292b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:18.906919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388837d-f3c5-4126-a457-c06ffe292b57 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed/users/5e7d08612f354561b5c296287bafb4c6/roles/ca65b374d43c43aabe987aabb7147e99` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:18.909526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388837d-f3c5-4126-a457-c06ffe292b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9222a29dae64be382f46397d59deaed, user_id=5e7d08612f354561b5c296287bafb4c6, role_id=ca65b374d43c43aabe987aabb7147e99)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:18.911295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388837d-f3c5-4126-a457-c06ffe292b57 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:19.039963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 121/234] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:18 2022] PUT /identity/v3/projects/c9222a29dae64be382f46397d59deaed/users/5e7d08612f354561b5c296287bafb4c6/roles/ca65b374d43c43aabe987aabb7147e99 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:19.734313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0e720-d350-40c8-8092-fc56e9abf35e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:19.734860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0e720-d350-40c8-8092-fc56e9abf35e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:19.734860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0e720-d350-40c8-8092-fc56e9abf35e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:19.736560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 114/235] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:19.741866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65e18-4c12-4074-885e-0f99058f47d9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:19.742280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65e18-4c12-4074-885e-0f99058f47d9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:19.742467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65e18-4c12-4074-885e-0f99058f47d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:19.769246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-def65e18-4c12-4074-885e-0f99058f47d9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:19.770607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-def65e18-4c12-4074-885e-0f99058f47d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:19.849815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:19.867766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 122/236] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:20.026747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10a39-272a-4920-9352-1f8a2a7b81c0 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:20.027305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10a39-272a-4920-9352-1f8a2a7b81c0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:20.027584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10a39-272a-4920-9352-1f8a2a7b81c0 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:20.029281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 115/237] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:20.034452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101188e2-f36e-45d8-8167-844d22655eac None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:20.034982 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101188e2-f36e-45d8-8167-844d22655eac None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:20.035445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101188e2-f36e-45d8-8167-844d22655eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:20.059750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-101188e2-f36e-45d8-8167-844d22655eac None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:20.061369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-101188e2-f36e-45d8-8167-844d22655eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:20.149443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 123/238] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:20.288545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10a39-272a-4920-9352-1f8a2a7b81c0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:20.359063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:20.414230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10a39-272a-4920-9352-1f8a2a7b81c0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:20.454336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef7462-3400-4067-8b15-6da7244775d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:20.455308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7462-3400-4067-8b15-6da7244775d4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:20.455803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7462-3400-4067-8b15-6da7244775d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:20.456276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7462-3400-4067-8b15-6da7244775d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:20.457619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef7462-3400-4067-8b15-6da7244775d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:20.459250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef7462-3400-4067-8b15-6da7244775d4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:20.461326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 116/239] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:20.467360 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101188e2-f36e-45d8-8167-844d22655eac None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:20.568157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef7462-3400-4067-8b15-6da7244775d4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:20.606856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101188e2-f36e-45d8-8167-844d22655eac None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:20.640618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:20.674938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941dfc2-7446-4a15-b84d-4aa3827086ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:20.675792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941dfc2-7446-4a15-b84d-4aa3827086ac None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:20.676241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941dfc2-7446-4a15-b84d-4aa3827086ac None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:20.676668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941dfc2-7446-4a15-b84d-4aa3827086ac None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:20.677631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941dfc2-7446-4a15-b84d-4aa3827086ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:20.679336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941dfc2-7446-4a15-b84d-4aa3827086ac None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:20.687484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef7462-3400-4067-8b15-6da7244775d4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:20.727025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:20.734154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec397ea5-0db7-4122-b14b-01a30a491325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:20.734958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397ea5-0db7-4122-b14b-01a30a491325 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:20.735859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397ea5-0db7-4122-b14b-01a30a491325 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:20.736270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec397ea5-0db7-4122-b14b-01a30a491325 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:20.748223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec397ea5-0db7-4122-b14b-01a30a491325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:20.756327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 124/240] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:20 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:20.756327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f4ca3-0ce6-4074-8096-f7bee8db6029 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:20.756327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f4ca3-0ce6-4074-8096-f7bee8db6029 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:20.756327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f4ca3-0ce6-4074-8096-f7bee8db6029 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:20.756327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 125/241] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ec397ea5-0db7-4122-b14b-01a30a491325 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:20.762403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:20.763351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:20.764152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 117/242] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:20.770388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be72f8-b47c-4e85-bab9-9996983f590a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:20.770678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be72f8-b47c-4e85-bab9-9996983f590a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:20.770945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be72f8-b47c-4e85-bab9-9996983f590a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:20.778171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec397ea5-0db7-4122-b14b-01a30a491325 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:20.810001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-04be72f8-b47c-4e85-bab9-9996983f590a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:20.814826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-04be72f8-b47c-4e85-bab9-9996983f590a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:20.933423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec397ea5-0db7-4122-b14b-01a30a491325 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:20.967042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 126/243] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:20.976504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f9525-864e-41fb-9070-3db25cbb63c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:20.977366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f9525-864e-41fb-9070-3db25cbb63c9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:20.977856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f9525-864e-41fb-9070-3db25cbb63c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:20.978330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f9525-864e-41fb-9070-3db25cbb63c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:20.981211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f9525-864e-41fb-9070-3db25cbb63c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:20.981764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f9525-864e-41fb-9070-3db25cbb63c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:20.983346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f9525-864e-41fb-9070-3db25cbb63c9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:20.992702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 118/244] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:20.998680 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be72f8-b47c-4e85-bab9-9996983f590a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:21.101688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c154526-317e-4ae1-aa74-392f829fa52e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.101982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c154526-317e-4ae1-aa74-392f829fa52e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.102159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c154526-317e-4ae1-aa74-392f829fa52e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.103654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 119/245] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:21.106202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:21.109370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be72f8-b47c-4e85-bab9-9996983f590a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:21.111130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6b77-3583-4e27-b36a-38dd616bea52 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.111421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6b77-3583-4e27-b36a-38dd616bea52 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.111716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6b77-3583-4e27-b36a-38dd616bea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.165595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-56eb6b77-3583-4e27-b36a-38dd616bea52 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:21.167844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-56eb6b77-3583-4e27-b36a-38dd616bea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:21.194202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182565-c753-4fe9-b8a4-b0caadfedeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:21.194975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182565-c753-4fe9-b8a4-b0caadfedeff None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.195260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182565-c753-4fe9-b8a4-b0caadfedeff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.195535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182565-c753-4fe9-b8a4-b0caadfedeff None admin] PATH_INFO: `/v3/users/9dcbee1eb3d34ab6a933024378f92bfc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.212877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182565-c753-4fe9-b8a4-b0caadfedeff None admin] RBAC: Authorizing `identity:get_user(user_id=9dcbee1eb3d34ab6a933024378f92bfc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:21.214987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182565-c753-4fe9-b8a4-b0caadfedeff None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:21.217010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 127/246] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:20 2022] GET /identity/v3/users/9dcbee1eb3d34ab6a933024378f92bfc => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:21.224625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182565-c753-4fe9-b8a4-b0caadfedeff None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:21.233212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:21.259766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 120/247] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:21.327979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb6b77-3583-4e27-b36a-38dd616bea52 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:21.342762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182565-c753-4fe9-b8a4-b0caadfedeff None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:21.386623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629c79d-74d7-4ba4-a73d-a23efcc288e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:21.387244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c79d-74d7-4ba4-a73d-a23efcc288e9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.387527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c79d-74d7-4ba4-a73d-a23efcc288e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.387813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c79d-74d7-4ba4-a73d-a23efcc288e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.423416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:21.459781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb6b77-3583-4e27-b36a-38dd616bea52 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:21.475936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629c79d-74d7-4ba4-a73d-a23efcc288e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:21.478100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629c79d-74d7-4ba4-a73d-a23efcc288e9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:21.502877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53969a-5303-4681-aed9-d38b836af101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:21.503990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53969a-5303-4681-aed9-d38b836af101 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.504527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53969a-5303-4681-aed9-d38b836af101 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.505044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53969a-5303-4681-aed9-d38b836af101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.520908 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53969a-5303-4681-aed9-d38b836af101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5a53969a-5303-4681-aed9-d38b836af101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:21.528583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:21.529518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:21.530344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:21.533945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 121/248] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:06:21.538821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53969a-5303-4681-aed9-d38b836af101 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:21.602634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:21.603814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 128/249] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:21.609122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344a826-b724-40a6-9df4-0cd2d73cf0f5 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.609414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344a826-b724-40a6-9df4-0cd2d73cf0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.609771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344a826-b724-40a6-9df4-0cd2d73cf0f5 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.611219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 129/250] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:21.616267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344a826-b724-40a6-9df4-0cd2d73cf0f5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:21.679906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53969a-5303-4681-aed9-d38b836af101 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:21.696321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:21.723971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48723fa4-041c-48e3-b26a-08a4c623c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:21.725013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723fa4-041c-48e3-b26a-08a4c623c359 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.725531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723fa4-041c-48e3-b26a-08a4c623c359 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.726033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48723fa4-041c-48e3-b26a-08a4c623c359 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.727027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723fa4-041c-48e3-b26a-08a4c623c359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:21.728013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723fa4-041c-48e3-b26a-08a4c623c359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:21.731530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48723fa4-041c-48e3-b26a-08a4c623c359 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:21.744557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 122/251] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:21.747558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dfb5-d270-4e1b-98e8-fd0927288b8a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.748047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dfb5-d270-4e1b-98e8-fd0927288b8a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.748872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430dfb5-d270-4e1b-98e8-fd0927288b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.756132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344a826-b724-40a6-9df4-0cd2d73cf0f5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:21.772673 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d430dfb5-d270-4e1b-98e8-fd0927288b8a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:21.774861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d430dfb5-d270-4e1b-98e8-fd0927288b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:21.793971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13a31-16d9-4f2d-aa54-2f056bf0e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:21.794612 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13a31-16d9-4f2d-aa54-2f056bf0e223 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:21.794886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13a31-16d9-4f2d-aa54-2f056bf0e223 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:21.795163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13a31-16d9-4f2d-aa54-2f056bf0e223 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:21.796394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13a31-16d9-4f2d-aa54-2f056bf0e223 None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:21.797853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13a31-16d9-4f2d-aa54-2f056bf0e223 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:21.804517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 130/252] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:21 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:21.805412 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13a31-16d9-4f2d-aa54-2f056bf0e223 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:21.867689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 123/253] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:21.869128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430dfb5-d270-4e1b-98e8-fd0927288b8a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:21.940433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:21.995696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13a31-16d9-4f2d-aa54-2f056bf0e223 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:22.014261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430dfb5-d270-4e1b-98e8-fd0927288b8a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:22.051637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:22.055711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592d9c-bdb8-4c9f-bb58-7049a8169cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:22.056728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592d9c-bdb8-4c9f-bb58-7049a8169cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:22.057335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592d9c-bdb8-4c9f-bb58-7049a8169cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:22.057787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a592d9c-bdb8-4c9f-bb58-7049a8169cc4 None admin] PATH_INFO: `/v3/users/5e7d08612f354561b5c296287bafb4c6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:22.059645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592d9c-bdb8-4c9f-bb58-7049a8169cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=5e7d08612f354561b5c296287bafb4c6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:22.061481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a592d9c-bdb8-4c9f-bb58-7049a8169cc4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:22.063735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 124/254] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:21 2022] GET /identity/v3/users/5e7d08612f354561b5c296287bafb4c6 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:22.064769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592d9c-bdb8-4c9f-bb58-7049a8169cc4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:22.074648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f12a-476f-4d09-88ee-66cc9ab6e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:22.075036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f12a-476f-4d09-88ee-66cc9ab6e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:22.075320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f12a-476f-4d09-88ee-66cc9ab6e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:22.075598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6f12a-476f-4d09-88ee-66cc9ab6e1e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:22.105357 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6f12a-476f-4d09-88ee-66cc9ab6e1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e7c6f12a-476f-4d09-88ee-66cc9ab6e1e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:22.110801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:22.111684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:22.112522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:22.119877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 131/255] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:22.120560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f12a-476f-4d09-88ee-66cc9ab6e1e4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:22.177875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a592d9c-bdb8-4c9f-bb58-7049a8169cc4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:22.179607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:22.239724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:22.240756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:22.241217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:22.241664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:22.243321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] RBAC: Adding query filter params (role.id=96c3f321e7a94ce88e601331d741c325, scope.project.id=c9222a29dae64be382f46397d59deaed, user.id=9dcbee1eb3d34ab6a933024378f92bfc) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:22.244943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:22.248977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:22.259877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 125/256] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:22 2022] GET /identity/v3/role_assignments?user.id=9dcbee1eb3d34ab6a933024378f92bfc&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=96c3f321e7a94ce88e601331d741c325 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:22.264164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:22.403895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073849f-8b74-4323-bc72-fcee6e4f9098 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:22.428283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6f12a-476f-4d09-88ee-66cc9ab6e1e4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:22.458111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:22.458778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:22.459021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:22.459362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:22.459988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:22.460329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:22.462003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:22.474063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 126/257] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:22.475676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c812e9-5d0c-46fd-9061-2fca32d29ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:22.476529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c812e9-5d0c-46fd-9061-2fca32d29ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:22.477001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c812e9-5d0c-46fd-9061-2fca32d29ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:22.477454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c812e9-5d0c-46fd-9061-2fca32d29ab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:22.479472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:22.544126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:22.620846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:22.628610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a70f-8cbc-4d8f-b849-1c14d80a82fb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:22.662302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c812e9-5d0c-46fd-9061-2fca32d29ab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:22.663972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c812e9-5d0c-46fd-9061-2fca32d29ab2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:22.677197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a065eb6-c350-4282-b9b9-6f2f20fa4738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:22.677837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a065eb6-c350-4282-b9b9-6f2f20fa4738 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:22.678114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a065eb6-c350-4282-b9b9-6f2f20fa4738 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:22.678385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a065eb6-c350-4282-b9b9-6f2f20fa4738 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:22.696695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a065eb6-c350-4282-b9b9-6f2f20fa4738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4a065eb6-c350-4282-b9b9-6f2f20fa4738 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:22.701720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:22.702605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:22.703426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:22.706604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 127/258] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:22.707385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a065eb6-c350-4282-b9b9-6f2f20fa4738 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:22.849823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:22.853819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 132/259] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:22.854714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c812e9-5d0c-46fd-9061-2fca32d29ab2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:22.874869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a065eb6-c350-4282-b9b9-6f2f20fa4738 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:22.950218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f26cc-f208-4586-a915-59018e9026cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:22.950868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f26cc-f208-4586-a915-59018e9026cb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:22.951154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f26cc-f208-4586-a915-59018e9026cb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:22.951429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f26cc-f208-4586-a915-59018e9026cb None admin] PATH_INFO: `/v3/users/82830568253d48cbbacd5a2a41b3e77c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:22.952613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f26cc-f208-4586-a915-59018e9026cb None admin] RBAC: Authorizing `identity:get_user(user_id=82830568253d48cbbacd5a2a41b3e77c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:22.954082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f26cc-f208-4586-a915-59018e9026cb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:22.955671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 128/260] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:22 2022] GET /identity/v3/users/82830568253d48cbbacd5a2a41b3e77c => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:22.956472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f26cc-f208-4586-a915-59018e9026cb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:22.961507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:22.978807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c812e9-5d0c-46fd-9061-2fca32d29ab2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:23.016541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:23.017158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.017484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.017871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.018549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:23.018855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:23.020236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:23.030023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 133/261] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:23.030873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:23.142409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85128873-975e-471c-9c3f-6aa2fe0e55a6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:23.180081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d85e97-2fe6-4115-bad5-a84c40f116b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:23.180762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85e97-2fe6-4115-bad5-a84c40f116b4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.181046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85e97-2fe6-4115-bad5-a84c40f116b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.181323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d85e97-2fe6-4115-bad5-a84c40f116b4 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.183440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d85e97-2fe6-4115-bad5-a84c40f116b4 None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:23.185055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d85e97-2fe6-4115-bad5-a84c40f116b4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:23.187131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 134/262] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:23 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:23.187977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d85e97-2fe6-4115-bad5-a84c40f116b4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:23.193357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f26cc-f208-4586-a915-59018e9026cb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:23.225979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:23.246419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c000a61-b5c0-4724-8b42-b7266736e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:23.247404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c000a61-b5c0-4724-8b42-b7266736e819 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.247847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c000a61-b5c0-4724-8b42-b7266736e819 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.248277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c000a61-b5c0-4724-8b42-b7266736e819 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.250081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c000a61-b5c0-4724-8b42-b7266736e819 None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:23.252189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c000a61-b5c0-4724-8b42-b7266736e819 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:23.254802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 129/263] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:22 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:23.256145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c000a61-b5c0-4724-8b42-b7266736e819 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:23.288439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:23.377804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c000a61-b5c0-4724-8b42-b7266736e819 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:23.420969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68fa2-d77f-464c-97a6-7c0800baac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:23.421154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d85e97-2fe6-4115-bad5-a84c40f116b4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:23.422073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68fa2-d77f-464c-97a6-7c0800baac14 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.422798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68fa2-d77f-464c-97a6-7c0800baac14 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.423434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68fa2-d77f-464c-97a6-7c0800baac14 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed/users/82830568253d48cbbacd5a2a41b3e77c/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.425691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c68fa2-d77f-464c-97a6-7c0800baac14 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9222a29dae64be382f46397d59deaed, user_id=82830568253d48cbbacd5a2a41b3e77c, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:23.427697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c68fa2-d77f-464c-97a6-7c0800baac14 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:23.467393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9887-f19e-4668-a5d2-42f60af5981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:23.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9887-f19e-4668-a5d2-42f60af5981d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.468335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9887-f19e-4668-a5d2-42f60af5981d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.468614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9887-f19e-4668-a5d2-42f60af5981d None admin] PATH_INFO: `/v3/users/5e7d08612f354561b5c296287bafb4c6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.469812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef9887-f19e-4668-a5d2-42f60af5981d None admin] RBAC: Authorizing `identity:get_user(user_id=5e7d08612f354561b5c296287bafb4c6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:23.471391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef9887-f19e-4668-a5d2-42f60af5981d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:23.473227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 135/264] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:23 2022] GET /identity/v3/users/5e7d08612f354561b5c296287bafb4c6 => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:23.473798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9887-f19e-4668-a5d2-42f60af5981d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:23.513457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 130/265] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:23 2022] PUT /identity/v3/projects/c9222a29dae64be382f46397d59deaed/users/82830568253d48cbbacd5a2a41b3e77c/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:23.514965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1e5d-9caf-455d-b17e-965e424d0590 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.515254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1e5d-9caf-455d-b17e-965e424d0590 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.515530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1e5d-9caf-455d-b17e-965e424d0590 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.521863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 131/266] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:23.527040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1e5d-9caf-455d-b17e-965e424d0590 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:23.588991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:23.612098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9887-f19e-4668-a5d2-42f60af5981d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:23.632903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:23.652709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1e5d-9caf-455d-b17e-965e424d0590 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:23.669652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cca26-a079-42a6-af69-ec2565f89481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:23.671037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cca26-a079-42a6-af69-ec2565f89481 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.671536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cca26-a079-42a6-af69-ec2565f89481 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.672226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cca26-a079-42a6-af69-ec2565f89481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.673556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cca26-a079-42a6-af69-ec2565f89481 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=c9222a29dae64be382f46397d59deaed, user.id=5e7d08612f354561b5c296287bafb4c6) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:23.674085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cca26-a079-42a6-af69-ec2565f89481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:23.675835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cca26-a079-42a6-af69-ec2565f89481 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:23.687052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 136/267] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:23 2022] GET /identity/v3/role_assignments?user.id=5e7d08612f354561b5c296287bafb4c6&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=fe95a036fa044c4bb408b793fba6436a => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:23.688558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437e55-e1c8-4f23-ae51-8f7b0fe46b34 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.688845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437e55-e1c8-4f23-ae51-8f7b0fe46b34 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.689126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437e55-e1c8-4f23-ae51-8f7b0fe46b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.694646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b193a-507e-4383-9f8b-cce6508d56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:23.695563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b193a-507e-4383-9f8b-cce6508d56b7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.696040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b193a-507e-4383-9f8b-cce6508d56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.696543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b193a-507e-4383-9f8b-cce6508d56b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.717012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-55437e55-e1c8-4f23-ae51-8f7b0fe46b34 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:23.718318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-55437e55-e1c8-4f23-ae51-8f7b0fe46b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:23.797691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b193a-507e-4383-9f8b-cce6508d56b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:23.800049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b193a-507e-4383-9f8b-cce6508d56b7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:23.805183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 137/268] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:23.806642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e17c8d-9fdc-4a2e-a394-b033f3da2282 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.807075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e17c8d-9fdc-4a2e-a394-b033f3da2282 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.812701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e17c8d-9fdc-4a2e-a394-b033f3da2282 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.812701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 138/269] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:23.818166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886049e-42a8-4556-907b-abef1d1c26b2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:23.818444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886049e-42a8-4556-907b-abef1d1c26b2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:23.818715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886049e-42a8-4556-907b-abef1d1c26b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:23.856153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7886049e-42a8-4556-907b-abef1d1c26b2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:23.861156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7886049e-42a8-4556-907b-abef1d1c26b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:23.946357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:23.967917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 132/270] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:23.973242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b193a-507e-4383-9f8b-cce6508d56b7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:24.013164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 139/271] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:24.084351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b193a-507e-4383-9f8b-cce6508d56b7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:24.120637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280975c-e2c2-4ee0-a8aa-d5c2eb93e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:24.121734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280975c-e2c2-4ee0-a8aa-d5c2eb93e7eb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.122210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280975c-e2c2-4ee0-a8aa-d5c2eb93e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.122677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280975c-e2c2-4ee0-a8aa-d5c2eb93e7eb None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.124093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280975c-e2c2-4ee0-a8aa-d5c2eb93e7eb None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:24.125857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280975c-e2c2-4ee0-a8aa-d5c2eb93e7eb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:24.128337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 133/272] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:23 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:24.136324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886049e-42a8-4556-907b-abef1d1c26b2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:24.154945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:24.195946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280975c-e2c2-4ee0-a8aa-d5c2eb93e7eb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:24.281620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886049e-42a8-4556-907b-abef1d1c26b2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:24.286258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:24.361702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:24.362346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.362626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.362898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.363634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] RBAC: Adding query filter params (role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=c9222a29dae64be382f46397d59deaed, user.id=5e7d08612f354561b5c296287bafb4c6) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:24.363938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:24.365399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:24.366024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280975c-e2c2-4ee0-a8aa-d5c2eb93e7eb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:24.372460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 140/273] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:24 2022] GET /identity/v3/role_assignments?user.id=5e7d08612f354561b5c296287bafb4c6&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:24.400218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:24.427289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665145e-0a28-448b-a6ce-8c897ef06c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:24.428544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665145e-0a28-448b-a6ce-8c897ef06c2f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.430881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665145e-0a28-448b-a6ce-8c897ef06c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.432955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665145e-0a28-448b-a6ce-8c897ef06c2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.455838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665145e-0a28-448b-a6ce-8c897ef06c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4665145e-0a28-448b-a6ce-8c897ef06c2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:24.467960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:24.469091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:24.469895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 134/274] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:24.476466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665145e-0a28-448b-a6ce-8c897ef06c2f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:24.541971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:24.580402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5a5a-6efc-4ffc-8e19-7659e405bc6a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:24.620449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6733b-eded-4ac6-860c-2ba511d186dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:24.621251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6733b-eded-4ac6-860c-2ba511d186dc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.621626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6733b-eded-4ac6-860c-2ba511d186dc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.622000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6733b-eded-4ac6-860c-2ba511d186dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.623322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6733b-eded-4ac6-860c-2ba511d186dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:24.624950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6733b-eded-4ac6-860c-2ba511d186dc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:24.627395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 141/275] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:24.633296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665145e-0a28-448b-a6ce-8c897ef06c2f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:24.638589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6733b-eded-4ac6-860c-2ba511d186dc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:24.648975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:24.680573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:24.681192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.683509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.683509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.683901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:24.684212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:24.685645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:24.696928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 135/276] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:24.702723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:24.761924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6733b-eded-4ac6-860c-2ba511d186dc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:24.801279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292b492-14d4-4207-b694-88655bae3e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:24.801914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292b492-14d4-4207-b694-88655bae3e14 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.802199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292b492-14d4-4207-b694-88655bae3e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.802474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292b492-14d4-4207-b694-88655bae3e14 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.803138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292b492-14d4-4207-b694-88655bae3e14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:24.804613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292b492-14d4-4207-b694-88655bae3e14 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:24.816252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:24.821263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3088f05-2db6-4cf8-94e7-2667ab503d8b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:24.858973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aa608-78a9-4aac-83f6-2356358ad510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:24.859632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa608-78a9-4aac-83f6-2356358ad510 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.859937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa608-78a9-4aac-83f6-2356358ad510 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.860212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa608-78a9-4aac-83f6-2356358ad510 None admin] PATH_INFO: `/v3/users/1fdc164645ef4b3d9d684339e7df573f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.874020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aa608-78a9-4aac-83f6-2356358ad510 None admin] RBAC: Authorizing `identity:get_user(user_id=1fdc164645ef4b3d9d684339e7df573f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:24.875656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aa608-78a9-4aac-83f6-2356358ad510 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:24.877554 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 136/277] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:24 2022] GET /identity/v3/users/1fdc164645ef4b3d9d684339e7df573f => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:24.878932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747abb10-fcf0-40ab-bdc2-3593e83a272a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.879048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 142/278] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:24 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:24.880690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747abb10-fcf0-40ab-bdc2-3593e83a272a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.881161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747abb10-fcf0-40ab-bdc2-3593e83a272a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.883189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 137/279] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:24.883304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292b492-14d4-4207-b694-88655bae3e14 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:24.894108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda77e79-be71-4ce6-afde-5c3eaaa036cf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:24.894734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda77e79-be71-4ce6-afde-5c3eaaa036cf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:24.895293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda77e79-be71-4ce6-afde-5c3eaaa036cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:24.923524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cda77e79-be71-4ce6-afde-5c3eaaa036cf None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:24.925934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cda77e79-be71-4ce6-afde-5c3eaaa036cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:24.968604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:25.013102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292b492-14d4-4207-b694-88655bae3e14 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:25.028441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 138/280] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:25.054002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:25.054540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:25.054819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:25.055089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:25.055817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] RBAC: Adding query filter params (role.id=983dd1ee6dee498dac7c66c3c5a68bc7, user.id=1fdc164645ef4b3d9d684339e7df573f, scope.system=all) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:25.056120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:25.057900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:25.063864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 143/281] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 10:06:24 2022] GET /identity/v3/role_assignments?user.id=1fdc164645ef4b3d9d684339e7df573f&scope.system=all&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:25.313963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda77e79-be71-4ce6-afde-5c3eaaa036cf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:25.421846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda77e79-be71-4ce6-afde-5c3eaaa036cf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:25.458219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f54d63-6b29-4405-8187-1430ee990b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:25.459235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f54d63-6b29-4405-8187-1430ee990b9b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:25.459718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f54d63-6b29-4405-8187-1430ee990b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:25.460209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f54d63-6b29-4405-8187-1430ee990b9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:25.476433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f54d63-6b29-4405-8187-1430ee990b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e0f54d63-6b29-4405-8187-1430ee990b9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:25.482000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:25.482909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:25.483731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 139/282] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:25.490878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:25.574423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:25.632385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082269ed-cac1-43cd-b5e5-657dea1e97ea None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:25.677207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6679c5f-92f1-4786-bcdd-1456ff00a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:25.677817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679c5f-92f1-4786-bcdd-1456ff00a992 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:25.678096 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679c5f-92f1-4786-bcdd-1456ff00a992 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:25.678365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6679c5f-92f1-4786-bcdd-1456ff00a992 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:25.679036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6679c5f-92f1-4786-bcdd-1456ff00a992 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:25.679339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6679c5f-92f1-4786-bcdd-1456ff00a992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:25.680817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6679c5f-92f1-4786-bcdd-1456ff00a992 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:25.691914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 144/283] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:25.697372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f54d63-6b29-4405-8187-1430ee990b9b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:25.728479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:25.788738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e92c-c746-4a96-9009-4f934a56c57e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:25.789064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e92c-c746-4a96-9009-4f934a56c57e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:25.789289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076e92c-c746-4a96-9009-4f934a56c57e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:25.790887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 145/284] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:25.797612 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18429c-88ea-4d68-b1c4-ebde374c35c7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:25.797898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18429c-88ea-4d68-b1c4-ebde374c35c7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:25.798171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18429c-88ea-4d68-b1c4-ebde374c35c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:25.817327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ab18429c-88ea-4d68-b1c4-ebde374c35c7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:25.818510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ab18429c-88ea-4d68-b1c4-ebde374c35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:25.831238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f54d63-6b29-4405-8187-1430ee990b9b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:25.874047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4749aa-b601-41ae-b186-9bb237e7b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:25.874680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4749aa-b601-41ae-b186-9bb237e7b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:25.874955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4749aa-b601-41ae-b186-9bb237e7b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:25.875224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4749aa-b601-41ae-b186-9bb237e7b2c0 None admin] PATH_INFO: `/v3/users/9dcbee1eb3d34ab6a933024378f92bfc` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:25.876994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4749aa-b601-41ae-b186-9bb237e7b2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=9dcbee1eb3d34ab6a933024378f92bfc)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:25.878475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4749aa-b601-41ae-b186-9bb237e7b2c0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:25.881187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 140/285] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:25 2022] GET /identity/v3/users/9dcbee1eb3d34ab6a933024378f92bfc => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:25.885957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4749aa-b601-41ae-b186-9bb237e7b2c0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:25.955329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 146/286] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:26.022059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:26.040385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4749aa-b601-41ae-b186-9bb237e7b2c0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:26.095300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8498e-de8b-4fbf-bf19-59d1cd5ccb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:26.095300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8498e-de8b-4fbf-bf19-59d1cd5ccb4a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:26.095300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8498e-de8b-4fbf-bf19-59d1cd5ccb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:26.095300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8498e-de8b-4fbf-bf19-59d1cd5ccb4a None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:26.095939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8498e-de8b-4fbf-bf19-59d1cd5ccb4a None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:26.097618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8498e-de8b-4fbf-bf19-59d1cd5ccb4a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:26.100025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 141/287] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:25 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:26.106592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18429c-88ea-4d68-b1c4-ebde374c35c7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:26.174704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:26.238815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18429c-88ea-4d68-b1c4-ebde374c35c7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:26.282784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6616eb-f201-4072-b2fd-c9d930f00ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:26.283789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6616eb-f201-4072-b2fd-c9d930f00ffd None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:26.284275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6616eb-f201-4072-b2fd-c9d930f00ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:26.284778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6616eb-f201-4072-b2fd-c9d930f00ffd None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed/users/9dcbee1eb3d34ab6a933024378f92bfc/roles/96c3f321e7a94ce88e601331d741c325` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:26.286932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6616eb-f201-4072-b2fd-c9d930f00ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=c9222a29dae64be382f46397d59deaed, user_id=9dcbee1eb3d34ab6a933024378f92bfc, role_id=96c3f321e7a94ce88e601331d741c325)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:26.288723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6616eb-f201-4072-b2fd-c9d930f00ffd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:26.363162 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8498e-de8b-4fbf-bf19-59d1cd5ccb4a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:26.384935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 147/288] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:06:26 2022] PUT /identity/v3/projects/c9222a29dae64be382f46397d59deaed/users/9dcbee1eb3d34ab6a933024378f92bfc/roles/96c3f321e7a94ce88e601331d741c325 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:26.506331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8498e-de8b-4fbf-bf19-59d1cd5ccb4a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:26.549331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02a836-9c58-4a50-9fa0-5f68fa1ce65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:26.550341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02a836-9c58-4a50-9fa0-5f68fa1ce65a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:26.550829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02a836-9c58-4a50-9fa0-5f68fa1ce65a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:26.551305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02a836-9c58-4a50-9fa0-5f68fa1ce65a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:26.569701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02a836-9c58-4a50-9fa0-5f68fa1ce65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-bf02a836-9c58-4a50-9fa0-5f68fa1ce65a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:26.576586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:26.577529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:26.578334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:26.589063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 142/289] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:26.593463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6616eb-f201-4072-b2fd-c9d930f00ffd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:26.730679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6616eb-f201-4072-b2fd-c9d930f00ffd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:26.743710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:26.772364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:26.772986 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:26.773268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:26.773595 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:26.774279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:26.774585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:26.775984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:26.788345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 148/290] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:26.795019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02a836-9c58-4a50-9fa0-5f68fa1ce65a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:26.827641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:26.938819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02a836-9c58-4a50-9fa0-5f68fa1ce65a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:26.986269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b65c0-4bff-4ec0-9a27-5fbf03f284f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:26.986825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b65c0-4bff-4ec0-9a27-5fbf03f284f7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:26.987102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b65c0-4bff-4ec0-9a27-5fbf03f284f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:26.987376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b65c0-4bff-4ec0-9a27-5fbf03f284f7 None admin] PATH_INFO: `/v3/users/82830568253d48cbbacd5a2a41b3e77c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:26.988567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b65c0-4bff-4ec0-9a27-5fbf03f284f7 None admin] RBAC: Authorizing `identity:get_user(user_id=82830568253d48cbbacd5a2a41b3e77c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:26.990037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b65c0-4bff-4ec0-9a27-5fbf03f284f7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:26.991622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 143/291] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:26 2022] GET /identity/v3/users/82830568253d48cbbacd5a2a41b3e77c => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:26.997944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:27.122317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd5692-460c-4f62-a7da-80556d8a87c7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:27.160025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16a5c-cbc3-4a2d-92a3-2078d21f61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:27.160670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16a5c-cbc3-4a2d-92a3-2078d21f61e5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.160953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16a5c-cbc3-4a2d-92a3-2078d21f61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.161226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16a5c-cbc3-4a2d-92a3-2078d21f61e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.210954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:27.238637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e16a5c-cbc3-4a2d-92a3-2078d21f61e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:27.240354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e16a5c-cbc3-4a2d-92a3-2078d21f61e5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:27.248530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f512c5-a10f-43cd-a792-04f2e8b1435d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.249041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f512c5-a10f-43cd-a792-04f2e8b1435d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.249041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f512c5-a10f-43cd-a792-04f2e8b1435d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.250632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 144/292] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:27.255514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff697e0-4eca-47d2-8fc8-222a6d57a5e8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.255797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff697e0-4eca-47d2-8fc8-222a6d57a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.256072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff697e0-4eca-47d2-8fc8-222a6d57a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.309296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fff697e0-4eca-47d2-8fc8-222a6d57a5e8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:27.310482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fff697e0-4eca-47d2-8fc8-222a6d57a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:27.349297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 149/293] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:27.358421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16a5c-cbc3-4a2d-92a3-2078d21f61e5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:27.404950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 145/294] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:27.481618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:27.517131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16a5c-cbc3-4a2d-92a3-2078d21f61e5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:27.558252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ff4fa-6bfb-426c-92f1-543334a0527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:27.558882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ff4fa-6bfb-426c-92f1-543334a0527b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.559163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ff4fa-6bfb-426c-92f1-543334a0527b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.559439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ff4fa-6bfb-426c-92f1-543334a0527b None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.560590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ff4fa-6bfb-426c-92f1-543334a0527b None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:27.562135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ff4fa-6bfb-426c-92f1-543334a0527b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:27.563772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 150/295] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:27 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:27.569907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff697e0-4eca-47d2-8fc8-222a6d57a5e8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:27.597127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:27.623756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826acea-5c70-4de8-b082-ce48aab5cae8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.624082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826acea-5c70-4de8-b082-ce48aab5cae8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.624361 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826acea-5c70-4de8-b082-ce48aab5cae8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.626061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 151/296] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:27.638060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec816-c26f-439e-9634-3d4f15c7daa5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.638348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec816-c26f-439e-9634-3d4f15c7daa5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.638624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ec816-c26f-439e-9634-3d4f15c7daa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.674787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2c0ec816-c26f-439e-9634-3d4f15c7daa5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:27.676107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2c0ec816-c26f-439e-9634-3d4f15c7daa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:27.687886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff697e0-4eca-47d2-8fc8-222a6d57a5e8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:27.722750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:27.723369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.723654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.723932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.724786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] RBAC: Adding query filter params (role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=c9222a29dae64be382f46397d59deaed, user.id=82830568253d48cbbacd5a2a41b3e77c) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:27.725369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:27.726824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:27.733866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 146/297] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:27 2022] GET /identity/v3/role_assignments?user.id=82830568253d48cbbacd5a2a41b3e77c&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:27.734796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:27.782557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 152/298] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:27.821309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f9316-c32e-4ced-b0cf-1eaf1244906e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.822029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f9316-c32e-4ced-b0cf-1eaf1244906e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.822574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f9316-c32e-4ced-b0cf-1eaf1244906e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.825245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 153/299] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:27.829010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:27.835416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccb62-6842-4797-a423-2d5e74932539 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.835416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccb62-6842-4797-a423-2d5e74932539 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.835416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ccb62-6842-4797-a423-2d5e74932539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.865614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d604-06d8-4a41-aa2c-2904712bcf13 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:27.880727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ad4ccb62-6842-4797-a423-2d5e74932539 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:27.882296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad4ccb62-6842-4797-a423-2d5e74932539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:27.939614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a713893-a8c6-4a95-9fc2-ecd85bcf07ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:27.940399 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a713893-a8c6-4a95-9fc2-ecd85bcf07ea None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:27.940752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a713893-a8c6-4a95-9fc2-ecd85bcf07ea None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:27.941104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a713893-a8c6-4a95-9fc2-ecd85bcf07ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:27.952218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a713893-a8c6-4a95-9fc2-ecd85bcf07ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8a713893-a8c6-4a95-9fc2-ecd85bcf07ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:27.959304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:27.960432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:27.961444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:27.963846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 147/300] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:27.971670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a713893-a8c6-4a95-9fc2-ecd85bcf07ea None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:27.988557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 154/301] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:28.085790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a713893-a8c6-4a95-9fc2-ecd85bcf07ea None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:28.125546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:28.126307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.126590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.126867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.127526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ccb62-6842-4797-a423-2d5e74932539 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:28.127978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:28.127978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:28.129243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:28.130572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:28.140817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 148/302] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:28.146375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:28.149369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:28.295859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea0804-35da-4c0e-9b6c-8651d560967c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:28.330627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ccb62-6842-4797-a423-2d5e74932539 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:28.334177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ddab1-0b53-42ab-8c9f-f25edc6dbb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:28.334896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ddab1-0b53-42ab-8c9f-f25edc6dbb04 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.335242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ddab1-0b53-42ab-8c9f-f25edc6dbb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.335604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ddab1-0b53-42ab-8c9f-f25edc6dbb04 None admin] PATH_INFO: `/v3/users/1fdc164645ef4b3d9d684339e7df573f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.336913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ddab1-0b53-42ab-8c9f-f25edc6dbb04 None admin] RBAC: Authorizing `identity:get_user(user_id=1fdc164645ef4b3d9d684339e7df573f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:28.338383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ddab1-0b53-42ab-8c9f-f25edc6dbb04 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:28.339972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 149/303] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:28 2022] GET /identity/v3/users/1fdc164645ef4b3d9d684339e7df573f => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:28.340753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ddab1-0b53-42ab-8c9f-f25edc6dbb04 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:28.371553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59047e7-15b0-445a-acef-16e2f316fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:28.372209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59047e7-15b0-445a-acef-16e2f316fab2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.372507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59047e7-15b0-445a-acef-16e2f316fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.372786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59047e7-15b0-445a-acef-16e2f316fab2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.383476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59047e7-15b0-445a-acef-16e2f316fab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a59047e7-15b0-445a-acef-16e2f316fab2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:28.388638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:28.389557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:28.390384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 155/304] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:28.391493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59047e7-15b0-445a-acef-16e2f316fab2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:28.423777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:28.457775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ddab1-0b53-42ab-8c9f-f25edc6dbb04 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:28.459505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:28.497102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c249a07-2965-4705-84f5-687b26b8f38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:28.497733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c249a07-2965-4705-84f5-687b26b8f38c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.498048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c249a07-2965-4705-84f5-687b26b8f38c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.498401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c249a07-2965-4705-84f5-687b26b8f38c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.499599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c249a07-2965-4705-84f5-687b26b8f38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:28.501083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c249a07-2965-4705-84f5-687b26b8f38c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:28.501884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59047e7-15b0-445a-acef-16e2f316fab2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:28.502843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 150/305] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:28.507868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c249a07-2965-4705-84f5-687b26b8f38c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:28.539723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7226-a5f8-4eb5-be54-f12fea5a0847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:28.540414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7226-a5f8-4eb5-be54-f12fea5a0847 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.540699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7226-a5f8-4eb5-be54-f12fea5a0847 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.540978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b7226-a5f8-4eb5-be54-f12fea5a0847 None admin] PATH_INFO: `/v3/system/users/1fdc164645ef4b3d9d684339e7df573f/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.542479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b7226-a5f8-4eb5-be54-f12fea5a0847 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1fdc164645ef4b3d9d684339e7df573f, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:28.543852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b7226-a5f8-4eb5-be54-f12fea5a0847 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:28.613111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c249a07-2965-4705-84f5-687b26b8f38c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:28.632424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 156/306] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Aug 28 10:06:28 2022] PUT /identity/v3/system/users/1fdc164645ef4b3d9d684339e7df573f/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:28.632424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7226-a5f8-4eb5-be54-f12fea5a0847 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:28.658292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:28.658965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.659250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.659523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.660212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:28.660545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:28.662097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:28.668917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:28.673677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 151/307] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:28.679473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:28.775952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b7226-a5f8-4eb5-be54-f12fea5a0847 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:28.798597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a63e70-e0ba-42e7-9625-c33a30ba50f9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:28.809024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:28.820081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e08971-1271-4185-9694-4c172c31a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:28.821120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e08971-1271-4185-9694-4c172c31a502 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.821576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e08971-1271-4185-9694-4c172c31a502 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.822038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e08971-1271-4185-9694-4c172c31a502 None admin] PATH_INFO: `/v3/groups` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.823624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e08971-1271-4185-9694-4c172c31a502 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:28.825257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e08971-1271-4185-9694-4c172c31a502 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:28.842156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c4085-8642-4e18-a75d-aada4addb0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:28.842787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4085-8642-4e18-a75d-aada4addb0bb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.843061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4085-8642-4e18-a75d-aada4addb0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.843328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4085-8642-4e18-a75d-aada4addb0bb None admin] PATH_INFO: `/v3/users/6c0d9424968a41b89efa65f9d69c63af` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.857411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c4085-8642-4e18-a75d-aada4addb0bb None admin] RBAC: Authorizing `identity:get_user(user_id=6c0d9424968a41b89efa65f9d69c63af)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:28.858862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c4085-8642-4e18-a75d-aada4addb0bb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:28.860535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 152/308] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:28 2022] GET /identity/v3/users/6c0d9424968a41b89efa65f9d69c63af => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:28.866716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80bbb0-0087-4f77-99f3-a508756ebd9e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.866716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80bbb0-0087-4f77-99f3-a508756ebd9e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.866716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80bbb0-0087-4f77-99f3-a508756ebd9e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.866716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 153/309] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:28.868023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80bbb0-0087-4f77-99f3-a508756ebd9e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:28.907715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 157/310] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Aug 28 10:06:28 2022] POST /identity/v3/groups => generated 229 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:28.908807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72bfc-3e85-44c9-9cc5-17b8bdce4a11 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:28.909159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72bfc-3e85-44c9-9cc5-17b8bdce4a11 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:28.909440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce72bfc-3e85-44c9-9cc5-17b8bdce4a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:28.932507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-dce72bfc-3e85-44c9-9cc5-17b8bdce4a11 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:28.934131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dce72bfc-3e85-44c9-9cc5-17b8bdce4a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:28.941849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:29.012221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80bbb0-0087-4f77-99f3-a508756ebd9e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:29.020163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 158/311] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:29.051628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:29.052256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:29.052559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:29.052833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:29.053595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] RBAC: Adding query filter params (role.id=96c3f321e7a94ce88e601331d741c325, user.id=6c0d9424968a41b89efa65f9d69c63af, scope.system=all) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:29.053885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:29.056446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:29.061670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 154/312] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 10:06:28 2022] GET /identity/v3/role_assignments?user.id=6c0d9424968a41b89efa65f9d69c63af&scope.system=all&role.id=96c3f321e7a94ce88e601331d741c325 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:29.298931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72bfc-3e85-44c9-9cc5-17b8bdce4a11 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:29.411869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce72bfc-3e85-44c9-9cc5-17b8bdce4a11 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:29.429412 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:29.448455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c6511-befb-4d63-960c-180b71de64a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:29.449091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c6511-befb-4d63-960c-180b71de64a3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:29.451958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c6511-befb-4d63-960c-180b71de64a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:29.451958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c6511-befb-4d63-960c-180b71de64a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:29.460027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c6511-befb-4d63-960c-180b71de64a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-685c6511-befb-4d63-960c-180b71de64a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:29.465259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:29.466148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:29.466968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 159/313] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:29.472228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:29.581140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a763-d95d-4ff8-899e-ba70d250f0a2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:29.605050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:29.616252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:29.616901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:29.623616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:29.623616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:29.623616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:29.623616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:29.623616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:29.629441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 155/314] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:29.636019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c6511-befb-4d63-960c-180b71de64a3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:29.739732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c6511-befb-4d63-960c-180b71de64a3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:29.775929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a128fac-59f9-40b1-95bc-8c958fd571d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:29.776592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128fac-59f9-40b1-95bc-8c958fd571d5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:29.776876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128fac-59f9-40b1-95bc-8c958fd571d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:29.777152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a128fac-59f9-40b1-95bc-8c958fd571d5 None admin] PATH_INFO: `/v3/users/9dcbee1eb3d34ab6a933024378f92bfc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:29.778308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a128fac-59f9-40b1-95bc-8c958fd571d5 None admin] RBAC: Authorizing `identity:get_user(user_id=9dcbee1eb3d34ab6a933024378f92bfc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:29.779757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a128fac-59f9-40b1-95bc-8c958fd571d5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:29.781390 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 160/315] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:29 2022] GET /identity/v3/users/9dcbee1eb3d34ab6a933024378f92bfc => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:29.787252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:29.898729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996ca8-565b-4d82-b794-3829c3b54ba6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:29.934600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12015240-b1b2-4dd1-9166-eeb95f11ffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:29.935218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015240-b1b2-4dd1-9166-eeb95f11ffca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:29.935503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015240-b1b2-4dd1-9166-eeb95f11ffca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:29.935772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12015240-b1b2-4dd1-9166-eeb95f11ffca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:30.001444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:30.005319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12015240-b1b2-4dd1-9166-eeb95f11ffca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:30.006874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12015240-b1b2-4dd1-9166-eeb95f11ffca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:30.113012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 156/316] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:30.121428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a128fac-59f9-40b1-95bc-8c958fd571d5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:30.171955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:30.233375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a128fac-59f9-40b1-95bc-8c958fd571d5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:30.267585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcc56a-1e2c-4b6c-9669-739a8173bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:30.268227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc56a-1e2c-4b6c-9669-739a8173bcea None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:30.268539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc56a-1e2c-4b6c-9669-739a8173bcea None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:30.268824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcc56a-1e2c-4b6c-9669-739a8173bcea None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:30.269950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcc56a-1e2c-4b6c-9669-739a8173bcea None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:30.271409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcc56a-1e2c-4b6c-9669-739a8173bcea None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:30.273169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 161/317] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:30 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:30.283327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12015240-b1b2-4dd1-9166-eeb95f11ffca None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:30.376943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:30.391412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12015240-b1b2-4dd1-9166-eeb95f11ffca None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:30.426764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc65c8e-14e6-41ec-8da6-7ce0b05f7440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:30.427380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65c8e-14e6-41ec-8da6-7ce0b05f7440 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:30.427660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65c8e-14e6-41ec-8da6-7ce0b05f7440 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:30.427934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc65c8e-14e6-41ec-8da6-7ce0b05f7440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:30.428706 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc65c8e-14e6-41ec-8da6-7ce0b05f7440 None admin] RBAC: Adding query filter params (role.id=96c3f321e7a94ce88e601331d741c325, scope.project.id=c9222a29dae64be382f46397d59deaed, user.id=9dcbee1eb3d34ab6a933024378f92bfc) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:30.429014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc65c8e-14e6-41ec-8da6-7ce0b05f7440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:30.430464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc65c8e-14e6-41ec-8da6-7ce0b05f7440 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:30.438008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 157/318] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:30 2022] GET /identity/v3/role_assignments?user.id=9dcbee1eb3d34ab6a933024378f92bfc&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=96c3f321e7a94ce88e601331d741c325 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:30.684492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12993d-84f8-4609-b414-87ab79c5178c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:30.684973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12993d-84f8-4609-b414-87ab79c5178c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:30.684973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12993d-84f8-4609-b414-87ab79c5178c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:30.686426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 162/319] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:30.691537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222aeb6-dc64-4c21-902b-07d5af9b7917 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:30.692002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222aeb6-dc64-4c21-902b-07d5af9b7917 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:30.692076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222aeb6-dc64-4c21-902b-07d5af9b7917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:30.709972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0222aeb6-dc64-4c21-902b-07d5af9b7917 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:30.711145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0222aeb6-dc64-4c21-902b-07d5af9b7917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:30.780838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 158/320] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:30.879242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e519-47d4-4191-81ca-662644958249 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:30.879524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e519-47d4-4191-81ca-662644958249 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:30.879798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e519-47d4-4191-81ca-662644958249 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:30.881302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 163/321] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:30.886381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2eecd-f91b-490c-a813-c5a44f1fae18 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:30.886670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2eecd-f91b-490c-a813-c5a44f1fae18 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:30.886943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2eecd-f91b-490c-a813-c5a44f1fae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:30.905362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5fa2eecd-f91b-490c-a813-c5a44f1fae18 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:30.906528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5fa2eecd-f91b-490c-a813-c5a44f1fae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:30.973825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 159/322] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:31.050053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773e519-47d4-4191-81ca-662644958249 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:31.058635 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0985-8583-428a-8091-07afbe749373 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.058925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0985-8583-428a-8091-07afbe749373 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.059240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e0985-8583-428a-8091-07afbe749373 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.061225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 160/323] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:31.065793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f6a09-37f7-4d6f-b336-85c5abeb7dd4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.066323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f6a09-37f7-4d6f-b336-85c5abeb7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.066323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f6a09-37f7-4d6f-b336-85c5abeb7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.084490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-123f6a09-37f7-4d6f-b336-85c5abeb7dd4 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:31.085675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-123f6a09-37f7-4d6f-b336-85c5abeb7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:31.087735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:31.156069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 161/324] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:31.165628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773e519-47d4-4191-81ca-662644958249 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:31.180170 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:31.201453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb677b0-d5cd-4bcd-9a43-fb3b34ef6cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:31.202229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb677b0-d5cd-4bcd-9a43-fb3b34ef6cca None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.202506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb677b0-d5cd-4bcd-9a43-fb3b34ef6cca None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.202777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb677b0-d5cd-4bcd-9a43-fb3b34ef6cca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.213875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb677b0-d5cd-4bcd-9a43-fb3b34ef6cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4cb677b0-d5cd-4bcd-9a43-fb3b34ef6cca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:31.218739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:31.219646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:31.225354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 164/325] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:31.227665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f6a09-37f7-4d6f-b336-85c5abeb7dd4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:31.237078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb677b0-d5cd-4bcd-9a43-fb3b34ef6cca None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:31.332095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f6a09-37f7-4d6f-b336-85c5abeb7dd4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:31.337574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb677b0-d5cd-4bcd-9a43-fb3b34ef6cca None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:31.366814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:31.367420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.367696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.367970 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.368861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:31.369434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:31.371864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:31.373996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d842-c703-4d53-96d5-fc5d0ea20993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:31.374622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d842-c703-4d53-96d5-fc5d0ea20993 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.374903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d842-c703-4d53-96d5-fc5d0ea20993 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.375173 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d842-c703-4d53-96d5-fc5d0ea20993 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.376264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d842-c703-4d53-96d5-fc5d0ea20993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:31.376956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:31.378356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d842-c703-4d53-96d5-fc5d0ea20993 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:31.380064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 165/326] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:31.380635 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 162/327] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:31.385888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d842-c703-4d53-96d5-fc5d0ea20993 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:31.386623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:31.430480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:31.489493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d842-c703-4d53-96d5-fc5d0ea20993 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:31.489685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513aaa99-6167-41a1-89c6-d3f352d2b9ec None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:31.522919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b8f95-a984-4f53-b226-afe736e00fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:31.523365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce235f1-5ae1-46ed-9d4a-acf8c3cbc56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:31.523540 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b8f95-a984-4f53-b226-afe736e00fbc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.523816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b8f95-a984-4f53-b226-afe736e00fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.523965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce235f1-5ae1-46ed-9d4a-acf8c3cbc56e None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.524067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b8f95-a984-4f53-b226-afe736e00fbc None admin] PATH_INFO: `/v3/users/1fdc164645ef4b3d9d684339e7df573f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.524247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce235f1-5ae1-46ed-9d4a-acf8c3cbc56e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.524551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce235f1-5ae1-46ed-9d4a-acf8c3cbc56e None admin] PATH_INFO: `/v3/groups` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.525210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b8f95-a984-4f53-b226-afe736e00fbc None admin] RBAC: Authorizing `identity:get_user(user_id=1fdc164645ef4b3d9d684339e7df573f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:31.525325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce235f1-5ae1-46ed-9d4a-acf8c3cbc56e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:31.526676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b8f95-a984-4f53-b226-afe736e00fbc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:31.526783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce235f1-5ae1-46ed-9d4a-acf8c3cbc56e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:31.528227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 163/328] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:31 2022] GET /identity/v3/users/1fdc164645ef4b3d9d684339e7df573f => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:31.533677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b8f95-a984-4f53-b226-afe736e00fbc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:31.594412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:31.598330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 166/329] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Aug 28 10:06:31 2022] POST /identity/v3/groups => generated 226 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:06:31.599229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce235f1-5ae1-46ed-9d4a-acf8c3cbc56e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:31.639636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b8f95-a984-4f53-b226-afe736e00fbc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:31.678247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e08016-cfda-4c0a-af5d-69da8edce743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:31.678958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e08016-cfda-4c0a-af5d-69da8edce743 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.679241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e08016-cfda-4c0a-af5d-69da8edce743 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.679567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e08016-cfda-4c0a-af5d-69da8edce743 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.691045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e08016-cfda-4c0a-af5d-69da8edce743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-59e08016-cfda-4c0a-af5d-69da8edce743 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:31.696597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:31.698096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:31.698907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:31.702838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 164/330] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:31.703593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e08016-cfda-4c0a-af5d-69da8edce743 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:31.727877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:31.731913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce235f1-5ae1-46ed-9d4a-acf8c3cbc56e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:31.772626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:31.773171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.773455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.773729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.774460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] RBAC: Adding query filter params (role.id=983dd1ee6dee498dac7c66c3c5a68bc7, user.id=1fdc164645ef4b3d9d684339e7df573f, scope.system=all) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:31.774769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:31.776934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:31.792434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 167/331] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 10:06:31 2022] GET /identity/v3/role_assignments?user.id=1fdc164645ef4b3d9d684339e7df573f&scope.system=all&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:31.828638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e08016-cfda-4c0a-af5d-69da8edce743 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:31.863629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:31.872549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:31.873190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:31.873474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:31.873752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:31.874465 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:31.874773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:31.876273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:31.887063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 165/332] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:31.893272 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:32.015920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a6a05-613d-4c13-87f0-ef059ccd7a38 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:32.054051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb9942-9e77-4280-bbc9-3887a9de27af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:32.054982 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9942-9e77-4280-bbc9-3887a9de27af None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:32.055399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9942-9e77-4280-bbc9-3887a9de27af None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:32.055822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9942-9e77-4280-bbc9-3887a9de27af None admin] PATH_INFO: `/v3/users/6c0d9424968a41b89efa65f9d69c63af` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:32.057750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb9942-9e77-4280-bbc9-3887a9de27af None admin] RBAC: Authorizing `identity:get_user(user_id=6c0d9424968a41b89efa65f9d69c63af)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:32.059424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb9942-9e77-4280-bbc9-3887a9de27af None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:32.065866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 168/333] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:31 2022] GET /identity/v3/users/6c0d9424968a41b89efa65f9d69c63af => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:32.067359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:32.177859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fa873-cf8c-4fae-83aa-9e2c94aeb677 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:32.216180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ffcb8-afba-4338-b50d-da6e76665c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:32.216874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffcb8-afba-4338-b50d-da6e76665c97 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:32.217154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffcb8-afba-4338-b50d-da6e76665c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:32.217430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ffcb8-afba-4338-b50d-da6e76665c97 None admin] PATH_INFO: `/v3/system/users/6c0d9424968a41b89efa65f9d69c63af/roles/96c3f321e7a94ce88e601331d741c325` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:32.218857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ffcb8-afba-4338-b50d-da6e76665c97 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6c0d9424968a41b89efa65f9d69c63af, role_id=96c3f321e7a94ce88e601331d741c325)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:32.220239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ffcb8-afba-4338-b50d-da6e76665c97 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:32.291087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 166/334] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Aug 28 10:06:32 2022] PUT /identity/v3/system/users/6c0d9424968a41b89efa65f9d69c63af/roles/96c3f321e7a94ce88e601331d741c325 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:33.774656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a537a4-5b9c-490c-af90-5fba899b41c6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:33.775177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a537a4-5b9c-490c-af90-5fba899b41c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:33.775253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a537a4-5b9c-490c-af90-5fba899b41c6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:33.777473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 169/335] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:33.782823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c98c7-4d0a-4023-a90f-2930974de679 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:33.783228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c98c7-4d0a-4023-a90f-2930974de679 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:33.783391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c98c7-4d0a-4023-a90f-2930974de679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:33.805841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3d8c98c7-4d0a-4023-a90f-2930974de679 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:33.807067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3d8c98c7-4d0a-4023-a90f-2930974de679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:33.872241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:33.894267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 167/336] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:34.275703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f2ab-7689-4474-a613-3461a4ad6694 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:34.276120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f2ab-7689-4474-a613-3461a4ad6694 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:34.276647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864f2ab-7689-4474-a613-3461a4ad6694 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:34.278278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 170/337] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:34.283447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62970d-e084-4c7f-9daa-3335e153f233 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:34.283739 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62970d-e084-4c7f-9daa-3335e153f233 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:34.284013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62970d-e084-4c7f-9daa-3335e153f233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:34.309294 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4c62970d-e084-4c7f-9daa-3335e153f233 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:34.310476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4c62970d-e084-4c7f-9daa-3335e153f233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:34.392270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 168/338] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:34.477527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864f2ab-7689-4474-a613-3461a4ad6694 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:34.514191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:34.612905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864f2ab-7689-4474-a613-3461a4ad6694 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:34.620694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3095f-3149-42d2-bd39-c12cca9943a1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:34.620976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3095f-3149-42d2-bd39-c12cca9943a1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:34.621251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3095f-3149-42d2-bd39-c12cca9943a1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:34.622765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 169/339] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:34.628184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860f85-2b6a-4633-97e4-64046581c072 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:34.628524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860f85-2b6a-4633-97e4-64046581c072 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:34.628809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31860f85-2b6a-4633-97e4-64046581c072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:34.655415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63cb1-3b11-414e-a14c-b77ea22ecca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:34.656061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63cb1-3b11-414e-a14c-b77ea22ecca9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:34.656358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63cb1-3b11-414e-a14c-b77ea22ecca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:34.656639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d63cb1-3b11-414e-a14c-b77ea22ecca9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:34.667735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-31860f85-2b6a-4633-97e4-64046581c072 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:34.668986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-31860f85-2b6a-4633-97e4-64046581c072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:34.677210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d63cb1-3b11-414e-a14c-b77ea22ecca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-33d63cb1-3b11-414e-a14c-b77ea22ecca9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:34.682218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:34.683327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:34.684146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 171/340] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:34.689226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63cb1-3b11-414e-a14c-b77ea22ecca9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:34.770921 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 170/341] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:34.772539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717628b-6e5e-4e16-a5e6-ef19ae2f3949 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:34.773049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717628b-6e5e-4e16-a5e6-ef19ae2f3949 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:34.773519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717628b-6e5e-4e16-a5e6-ef19ae2f3949 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:34.774959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 171/342] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:34.781284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f1228-e8a7-47a9-81e5-8697f347d30e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:34.781821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f1228-e8a7-47a9-81e5-8697f347d30e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:34.782311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f1228-e8a7-47a9-81e5-8697f347d30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:34.816400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7a8f1228-e8a7-47a9-81e5-8697f347d30e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:34.818436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7a8f1228-e8a7-47a9-81e5-8697f347d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:34.820662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:34.825106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d63cb1-3b11-414e-a14c-b77ea22ecca9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:34.868116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:34.872735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:34.873026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:34.873308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:34.874001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:34.874308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:34.875683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:34.900141 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 172/343] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:34.905058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:34.928139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:34.970144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 172/344] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:34.971049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f1228-e8a7-47a9-81e5-8697f347d30e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:35.106944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df714c75-e45b-454e-b8d7-38d8753a9f27 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.169420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a10d4c-9ba5-4fc4-94a9-23ce32380229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:35.169987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10d4c-9ba5-4fc4-94a9-23ce32380229 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:35.170270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10d4c-9ba5-4fc4-94a9-23ce32380229 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:35.170546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10d4c-9ba5-4fc4-94a9-23ce32380229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:35.173166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f1228-e8a7-47a9-81e5-8697f347d30e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.201729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:35.243533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb226db-8154-482e-88c5-ccb86b3f29a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:35.244213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb226db-8154-482e-88c5-ccb86b3f29a0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:35.244532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb226db-8154-482e-88c5-ccb86b3f29a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:35.244791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb226db-8154-482e-88c5-ccb86b3f29a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:35.256710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb226db-8154-482e-88c5-ccb86b3f29a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2eb226db-8154-482e-88c5-ccb86b3f29a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:35.262773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:35.263882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:35.264918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:35.267517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 173/345] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:35.268580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb226db-8154-482e-88c5-ccb86b3f29a0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:35.324189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:35.341148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a10d4c-9ba5-4fc4-94a9-23ce32380229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:35.343439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a10d4c-9ba5-4fc4-94a9-23ce32380229 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:35.412867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb226db-8154-482e-88c5-ccb86b3f29a0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.448449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b048a-38c8-49b7-949d-308d271c4e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:35.449353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b048a-38c8-49b7-949d-308d271c4e14 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:35.449769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b048a-38c8-49b7-949d-308d271c4e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:35.450196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b048a-38c8-49b7-949d-308d271c4e14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:35.460810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b048a-38c8-49b7-949d-308d271c4e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ff8b048a-38c8-49b7-949d-308d271c4e14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:35.466686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:35.467858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 10:06:35.468895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:35.471077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 174/346] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:35.472024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b048a-38c8-49b7-949d-308d271c4e14 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:35.476852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 173/347] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 10:06:35.477433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a10d4c-9ba5-4fc4-94a9-23ce32380229 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:35.531045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:35.574681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:35.581641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b048a-38c8-49b7-949d-308d271c4e14 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.590222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a10d4c-9ba5-4fc4-94a9-23ce32380229 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.618065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:35.619025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:35.620030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:35.620528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:35.621463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:35.621939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:35.623574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:35.627195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27fd3-5976-46c4-ad57-c5633127806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:35.627836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27fd3-5976-46c4-ad57-c5633127806c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:35.628116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27fd3-5976-46c4-ad57-c5633127806c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:35.628427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27fd3-5976-46c4-ad57-c5633127806c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:35.633770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 175/348] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:35.634982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:35.645021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de27fd3-5976-46c4-ad57-c5633127806c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9de27fd3-5976-46c4-ad57-c5633127806c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:35.650618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:35.651614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:35.652451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:35.656398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 174/349] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:35.657273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27fd3-5976-46c4-ad57-c5633127806c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:35.750647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3e38-0996-4184-b8e0-80ec57088a3c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.765744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27fd3-5976-46c4-ad57-c5633127806c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.779854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:35.795120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:35.796583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:35.797106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:35.797523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:35.798501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:35.799269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:35.801135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:35.804205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e86cc-0faa-4493-859b-2bbb75a85e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:35.804988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e86cc-0faa-4493-859b-2bbb75a85e24 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:35.805364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e86cc-0faa-4493-859b-2bbb75a85e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:35.805742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e86cc-0faa-4493-859b-2bbb75a85e24 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:35.807537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e86cc-0faa-4493-859b-2bbb75a85e24 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:35.809679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e86cc-0faa-4493-859b-2bbb75a85e24 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:35.812568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 175/350] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:35 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:35.813038 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 176/351] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:35.814046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:35.814177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e86cc-0faa-4493-859b-2bbb75a85e24 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:35.842992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:35.951795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceafcc1-8855-4fec-abaa-dbc8afe7f718 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.959316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e86cc-0faa-4493-859b-2bbb75a85e24 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:35.996870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb68029-b2f2-450b-be5d-09afced6a381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:35.997607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68029-b2f2-450b-be5d-09afced6a381 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:35.997785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68029-b2f2-450b-be5d-09afced6a381 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:35.998032 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68029-b2f2-450b-be5d-09afced6a381 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:35.998711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb68029-b2f2-450b-be5d-09afced6a381 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:35.999047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb68029-b2f2-450b-be5d-09afced6a381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:36.000430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb68029-b2f2-450b-be5d-09afced6a381 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:36.002891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6493b-40c3-4895-a7ec-387eedefef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:36.003447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6493b-40c3-4895-a7ec-387eedefef9e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.003724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6493b-40c3-4895-a7ec-387eedefef9e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.003995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6493b-40c3-4895-a7ec-387eedefef9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.012528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 177/352] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:36.016232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd9d15-3981-4e0d-8454-f806b7b65817 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.016232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd9d15-3981-4e0d-8454-f806b7b65817 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.016232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd9d15-3981-4e0d-8454-f806b7b65817 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.016232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 178/353] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:36.016567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd9d15-3981-4e0d-8454-f806b7b65817 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:36.066537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:36.094938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6493b-40c3-4895-a7ec-387eedefef9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:36.096475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6493b-40c3-4895-a7ec-387eedefef9e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:36.116148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:36.151114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd9d15-3981-4e0d-8454-f806b7b65817 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:36.203414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb75b66-95ba-42c6-8691-1bb343d7abc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:36.203943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb75b66-95ba-42c6-8691-1bb343d7abc6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.204314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb75b66-95ba-42c6-8691-1bb343d7abc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.204570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb75b66-95ba-42c6-8691-1bb343d7abc6 None admin] PATH_INFO: `/v3/users/6c0d9424968a41b89efa65f9d69c63af` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.205803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb75b66-95ba-42c6-8691-1bb343d7abc6 None admin] RBAC: Authorizing `identity:get_user(user_id=6c0d9424968a41b89efa65f9d69c63af)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:36.207267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb75b66-95ba-42c6-8691-1bb343d7abc6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:36.209371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 179/354] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:06:36 2022] GET /identity/v3/users/6c0d9424968a41b89efa65f9d69c63af => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:36.210986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb75b66-95ba-42c6-8691-1bb343d7abc6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:36.224535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 176/355] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:36.225676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c5d9-34c5-4fbf-81a0-c73fc60ab611 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.226193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c5d9-34c5-4fbf-81a0-c73fc60ab611 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.226397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c5d9-34c5-4fbf-81a0-c73fc60ab611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.247395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-04f1c5d9-34c5-4fbf-81a0-c73fc60ab611 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:36.248719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-04f1c5d9-34c5-4fbf-81a0-c73fc60ab611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:36.330416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb75b66-95ba-42c6-8691-1bb343d7abc6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:36.337237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 177/356] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:36.338255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1c5d9-34c5-4fbf-81a0-c73fc60ab611 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:36.347621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:36.380319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8f4c-dd45-4817-ae2f-8dc8bf831fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:36.380319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8f4c-dd45-4817-ae2f-8dc8bf831fdf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.380319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8f4c-dd45-4817-ae2f-8dc8bf831fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.380319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8f4c-dd45-4817-ae2f-8dc8bf831fdf None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.384463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8f4c-dd45-4817-ae2f-8dc8bf831fdf None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:36.386033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8f4c-dd45-4817-ae2f-8dc8bf831fdf None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:36.387660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 180/357] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:36 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:36.388525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8f4c-dd45-4817-ae2f-8dc8bf831fdf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:36.404636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:36.486453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1c5d9-34c5-4fbf-81a0-c73fc60ab611 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:36.532641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8f4c-dd45-4817-ae2f-8dc8bf831fdf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:36.532832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29651179-b22d-4e28-a535-4ee4b6a905bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:36.533461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651179-b22d-4e28-a535-4ee4b6a905bc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.533901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651179-b22d-4e28-a535-4ee4b6a905bc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.534187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651179-b22d-4e28-a535-4ee4b6a905bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.577144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:36.577913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.578289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.578656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.579395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] RBAC: Adding query filter params (role.id=96c3f321e7a94ce88e601331d741c325, user.id=6c0d9424968a41b89efa65f9d69c63af, scope.system=all) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:36.579698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:36.582724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:36.599123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 181/358] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 28 10:06:36 2022] GET /identity/v3/role_assignments?user.id=6c0d9424968a41b89efa65f9d69c63af&scope.system=all&role.id=96c3f321e7a94ce88e601331d741c325 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:36.600552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:36.635829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29651179-b22d-4e28-a535-4ee4b6a905bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:36.637395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29651179-b22d-4e28-a535-4ee4b6a905bc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:36.646791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:36.708128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:36.752408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3b2a9-b92f-40a1-a913-f34c14f1025e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:36.783687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 178/359] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:36.786490 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6551ea7-3645-4c96-9098-3c99ef579d84 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.786779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6551ea7-3645-4c96-9098-3c99ef579d84 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.787053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6551ea7-3645-4c96-9098-3c99ef579d84 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.788380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 179/360] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:36.789409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6551ea7-3645-4c96-9098-3c99ef579d84 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:36.794333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556fc2a-46e5-449f-bf56-8e969e1f1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:36.795012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556fc2a-46e5-449f-bf56-8e969e1f1519 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.795257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556fc2a-46e5-449f-bf56-8e969e1f1519 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.795523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556fc2a-46e5-449f-bf56-8e969e1f1519 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.796672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556fc2a-46e5-449f-bf56-8e969e1f1519 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:36.799254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556fc2a-46e5-449f-bf56-8e969e1f1519 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:36.801255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 182/361] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:36 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:36.802027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556fc2a-46e5-449f-bf56-8e969e1f1519 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:36.925896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556fc2a-46e5-449f-bf56-8e969e1f1519 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:36.929255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6551ea7-3645-4c96-9098-3c99ef579d84 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:36.937433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:36.964527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036952aa-e30f-44c9-9c3c-965e1da41e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:36.965169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036952aa-e30f-44c9-9c3c-965e1da41e6d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.965448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036952aa-e30f-44c9-9c3c-965e1da41e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.965728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036952aa-e30f-44c9-9c3c-965e1da41e6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.970036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:36.971138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.972183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.972183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:36.972475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] RBAC: Adding query filter params (group.id=d66234439c70410e990d0099f807ea2b, role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=16145402c02e4b02a32a9d3478528966) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:36.972738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:36.974159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:36.980416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 180/362] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:36 2022] GET /identity/v3/role_assignments?group.id=d66234439c70410e990d0099f807ea2b&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:36.982028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:36.982148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:36.982758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036952aa-e30f-44c9-9c3c-965e1da41e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-036952aa-e30f-44c9-9c3c-965e1da41e6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:36.988726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:36.997506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 183/363] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:36.998335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b768-8f95-4b26-98d4-e20d42db6a2c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:36.999075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b768-8f95-4b26-98d4-e20d42db6a2c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:36.999075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b768-8f95-4b26-98d4-e20d42db6a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.015575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-af60b768-8f95-4b26-98d4-e20d42db6a2c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:37.019728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-af60b768-8f95-4b26-98d4-e20d42db6a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:37.113508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 184/364] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:37.114646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60b768-8f95-4b26-98d4-e20d42db6a2c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:37.122906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a145907-3c49-4ae5-8b49-a9e712628f53 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:37.190909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbcb45-c63f-4bb9-94a5-d82764024f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:37.192282 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbcb45-c63f-4bb9-94a5-d82764024f6a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:37.192753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbcb45-c63f-4bb9-94a5-d82764024f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:37.193172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbcb45-c63f-4bb9-94a5-d82764024f6a None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.195166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbcb45-c63f-4bb9-94a5-d82764024f6a None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:37.197106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbcb45-c63f-4bb9-94a5-d82764024f6a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:37.200522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 181/365] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:36 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:37.201883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbcb45-c63f-4bb9-94a5-d82764024f6a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:37.260143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:37.274193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60b768-8f95-4b26-98d4-e20d42db6a2c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:37.309376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:37.318750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e037a-f416-44c3-8906-fa33465f869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:37.319509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e037a-f416-44c3-8906-fa33465f869f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:37.319950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e037a-f416-44c3-8906-fa33465f869f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:37.320283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e037a-f416-44c3-8906-fa33465f869f None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.322024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e037a-f416-44c3-8906-fa33465f869f None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:37.324001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e037a-f416-44c3-8906-fa33465f869f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:37.326293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 185/366] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:37.328483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e037a-f416-44c3-8906-fa33465f869f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:37.338666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbcb45-c63f-4bb9-94a5-d82764024f6a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:37.387631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:37.388494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:37.388944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:37.389358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.390711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:37.391237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:37.392867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:37.404054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 182/367] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:37.405968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:37.457923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e037a-f416-44c3-8906-fa33465f869f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:37.499080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a00b3-76e1-44d5-a276-f5e8b78e4df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:37.499728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a00b3-76e1-44d5-a276-f5e8b78e4df3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:37.500006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a00b3-76e1-44d5-a276-f5e8b78e4df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:37.500282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a00b3-76e1-44d5-a276-f5e8b78e4df3 None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.501439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a00b3-76e1-44d5-a276-f5e8b78e4df3 None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:37.502897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a00b3-76e1-44d5-a276-f5e8b78e4df3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:37.505792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 186/368] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:37.506635 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a00b3-76e1-44d5-a276-f5e8b78e4df3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:37.534337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:37.537765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241bb97-e0ff-489c-a43f-8e38eb58cd24 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:37.586302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:37.587223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:37.587512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:37.587901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.588772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] RBAC: Adding query filter params (group.id=d66234439c70410e990d0099f807ea2b, role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=16145402c02e4b02a32a9d3478528966) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:37.589088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:37.591291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:37.598746 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 183/369] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/role_assignments?group.id=d66234439c70410e990d0099f807ea2b&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:37.599866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:37.619758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:37.655396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a00b3-76e1-44d5-a276-f5e8b78e4df3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:37.696001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115bfbb-408c-4fde-8830-83c9566937fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:37.696680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115bfbb-408c-4fde-8830-83c9566937fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:37.697008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115bfbb-408c-4fde-8830-83c9566937fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:37.697792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5115bfbb-408c-4fde-8830-83c9566937fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.731544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a325c95-a524-4c58-823a-4ddc98cbfc42 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:37.769426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384139f7-70da-4b3f-8663-c3cdf9c95dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:37.770064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384139f7-70da-4b3f-8663-c3cdf9c95dba None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:37.770342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384139f7-70da-4b3f-8663-c3cdf9c95dba None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:37.770614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384139f7-70da-4b3f-8663-c3cdf9c95dba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.779905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115bfbb-408c-4fde-8830-83c9566937fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:37.782312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5115bfbb-408c-4fde-8830-83c9566937fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:37.783487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384139f7-70da-4b3f-8663-c3cdf9c95dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-384139f7-70da-4b3f-8663-c3cdf9c95dba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:37.788914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:37.790062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 184/370] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:37.792500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384139f7-70da-4b3f-8663-c3cdf9c95dba None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:37.819356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:37.868841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:37.917589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 187/371] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:37.918372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115bfbb-408c-4fde-8830-83c9566937fc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:37.935050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384139f7-70da-4b3f-8663-c3cdf9c95dba None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:37.983751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:37.985341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:37.985451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:37.985684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:37.986424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] RBAC: Adding query filter params (group.id=d66234439c70410e990d0099f807ea2b, role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=c9222a29dae64be382f46397d59deaed) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:37.986757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:37.988194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:37.999303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 185/372] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/role_assignments?group.id=d66234439c70410e990d0099f807ea2b&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:38.000463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:38.106053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5115bfbb-408c-4fde-8830-83c9566937fc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:38.116362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:38.132657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc26edf-5ac8-4d59-a21b-ea1702425d39 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:38.179779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c9d30-59a1-4102-a352-f834f9d92ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:38.180827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c9d30-59a1-4102-a352-f834f9d92ccd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:38.182499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c9d30-59a1-4102-a352-f834f9d92ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:38.183033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c9d30-59a1-4102-a352-f834f9d92ccd None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:38.184498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c9d30-59a1-4102-a352-f834f9d92ccd None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:38.186911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c9d30-59a1-4102-a352-f834f9d92ccd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:38.188824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 186/373] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:38.195203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c9d30-59a1-4102-a352-f834f9d92ccd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:38.207458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:38.208101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:38.208414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:38.208691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:38.209390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:38.209691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:38.211197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:38.237609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 188/374] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:38.242029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:38.279272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:38.341458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c9d30-59a1-4102-a352-f834f9d92ccd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:38.387479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba664611-8933-4ffa-9c72-7acebdd29663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:38.388114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664611-8933-4ffa-9c72-7acebdd29663 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:38.388424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664611-8933-4ffa-9c72-7acebdd29663 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:38.388760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba664611-8933-4ffa-9c72-7acebdd29663 None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:38.389889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba664611-8933-4ffa-9c72-7acebdd29663 None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:38.392040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba664611-8933-4ffa-9c72-7acebdd29663 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:38.393719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 187/375] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:38 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:38.398728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4d8ef-87ad-48bf-ad00-eae225bf49b0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:38.399601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba664611-8933-4ffa-9c72-7acebdd29663 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:38.434350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:38.466944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38e521-cea9-4b3e-babb-a1bf9cf5d928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:38.467560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e521-cea9-4b3e-babb-a1bf9cf5d928 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:38.467839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e521-cea9-4b3e-babb-a1bf9cf5d928 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:38.468114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e521-cea9-4b3e-babb-a1bf9cf5d928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:38.561518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba664611-8933-4ffa-9c72-7acebdd29663 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:38.588809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38e521-cea9-4b3e-babb-a1bf9cf5d928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:38.590292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38e521-cea9-4b3e-babb-a1bf9cf5d928 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:38.621798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:38.629604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:38.630512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:38.630912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:38.631280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:38.632113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] RBAC: Adding query filter params (group.id=d66234439c70410e990d0099f807ea2b, role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=c9222a29dae64be382f46397d59deaed) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:38.632581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:38.634093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:38.654635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 188/376] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:38 2022] GET /identity/v3/role_assignments?group.id=d66234439c70410e990d0099f807ea2b&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:38.716070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 189/377] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:38.721924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:38.850209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:38.862571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d77ddc-4e83-4c58-8add-e0a75213deb3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:38.906215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9515-a836-4d1f-a7d5-be310bb28e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:38.906953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9515-a836-4d1f-a7d5-be310bb28e3d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:38.907237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9515-a836-4d1f-a7d5-be310bb28e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:38.907514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9515-a836-4d1f-a7d5-be310bb28e3d None admin] PATH_INFO: `/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:38.913049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb9515-a836-4d1f-a7d5-be310bb28e3d None admin] RBAC: Authorizing `identity:get_project(project_id=86f5f0c06d84427a9264fb27dee1d3a9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:38.914770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb9515-a836-4d1f-a7d5-be310bb28e3d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:38.917242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 189/378] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:38 2022] GET /identity/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:38.922881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38e521-cea9-4b3e-babb-a1bf9cf5d928 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:39.073390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38e521-cea9-4b3e-babb-a1bf9cf5d928 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:39.100868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:39.113224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4f19b-11e9-4844-8b43-d47aa9a96414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:39.120718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4f19b-11e9-4844-8b43-d47aa9a96414 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:39.120718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4f19b-11e9-4844-8b43-d47aa9a96414 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:39.120718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4f19b-11e9-4844-8b43-d47aa9a96414 None admin] PATH_INFO: `/v3/groups/31599ed9156540a2a03d0717b111a4c9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:39.121403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4f19b-11e9-4844-8b43-d47aa9a96414 None admin] RBAC: Authorizing `identity:get_group(group_id=31599ed9156540a2a03d0717b111a4c9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:39.122967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4f19b-11e9-4844-8b43-d47aa9a96414 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:39.124699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 190/379] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:38 2022] GET /identity/v3/groups/31599ed9156540a2a03d0717b111a4c9 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:39.130501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9515-a836-4d1f-a7d5-be310bb28e3d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:39.269546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9515-a836-4d1f-a7d5-be310bb28e3d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:39.313914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89410d2c-0cbc-465a-b746-3e43bffc3588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:39.314529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410d2c-0cbc-465a-b746-3e43bffc3588 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:39.314814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410d2c-0cbc-465a-b746-3e43bffc3588 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:39.315094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410d2c-0cbc-465a-b746-3e43bffc3588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:39.315831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89410d2c-0cbc-465a-b746-3e43bffc3588 None admin] RBAC: Adding query filter params (group.id=31599ed9156540a2a03d0717b111a4c9, role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=86f5f0c06d84427a9264fb27dee1d3a9) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:39.316138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89410d2c-0cbc-465a-b746-3e43bffc3588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:39.317593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89410d2c-0cbc-465a-b746-3e43bffc3588 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:39.327729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 190/380] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:39 2022] GET /identity/v3/role_assignments?group.id=31599ed9156540a2a03d0717b111a4c9&scope.project.id=86f5f0c06d84427a9264fb27dee1d3a9&role.id=fe95a036fa044c4bb408b793fba6436a => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:39.340226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe79-00bd-421c-aa3c-fe5bc94b98b3 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:39.340878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe79-00bd-421c-aa3c-fe5bc94b98b3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:39.341349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe79-00bd-421c-aa3c-fe5bc94b98b3 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:39.342917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 191/381] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:39.348670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e930-f2c7-4173-bcdb-59053c9ecea2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:39.349283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e930-f2c7-4173-bcdb-59053c9ecea2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:39.349761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18e930-f2c7-4173-bcdb-59053c9ecea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:39.369860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ed18e930-f2c7-4173-bcdb-59053c9ecea2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:39.371926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ed18e930-f2c7-4173-bcdb-59053c9ecea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:39.388022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:39.449923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 191/382] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:39.837509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eabe79-00bd-421c-aa3c-fe5bc94b98b3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:39.949348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eabe79-00bd-421c-aa3c-fe5bc94b98b3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:39.986063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849044b8-bd0f-4207-8f2e-6e8bfeb92f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:39.987042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849044b8-bd0f-4207-8f2e-6e8bfeb92f52 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:39.987522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849044b8-bd0f-4207-8f2e-6e8bfeb92f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:39.988031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849044b8-bd0f-4207-8f2e-6e8bfeb92f52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:39.999912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849044b8-bd0f-4207-8f2e-6e8bfeb92f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-849044b8-bd0f-4207-8f2e-6e8bfeb92f52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:40.005120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:40.005989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:40.006810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:40.009143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 192/383] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:40.016086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18e930-f2c7-4173-bcdb-59053c9ecea2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:40.129026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18e930-f2c7-4173-bcdb-59053c9ecea2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:40.173834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275cd48-b0c4-4ed6-95ad-a05bc01a807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:40.175230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cd48-b0c4-4ed6-95ad-a05bc01a807f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.175707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cd48-b0c4-4ed6-95ad-a05bc01a807f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.176174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275cd48-b0c4-4ed6-95ad-a05bc01a807f None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.177085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275cd48-b0c4-4ed6-95ad-a05bc01a807f None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:40.177605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275cd48-b0c4-4ed6-95ad-a05bc01a807f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:40.179196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275cd48-b0c4-4ed6-95ad-a05bc01a807f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:40.190180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 192/384] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:40.196198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849044b8-bd0f-4207-8f2e-6e8bfeb92f52 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:40.252387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:40.286800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5e54-5524-42f9-a5a8-99cda1ccc8c4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.287105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5e54-5524-42f9-a5a8-99cda1ccc8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.288082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5e54-5524-42f9-a5a8-99cda1ccc8c4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.290369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 193/385] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:40.297292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a01a-e440-4629-b5d1-54abacdd04ee None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.297666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a01a-e440-4629-b5d1-54abacdd04ee None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.298014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a01a-e440-4629-b5d1-54abacdd04ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.319223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849044b8-bd0f-4207-8f2e-6e8bfeb92f52 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:40.321422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1783a01a-e440-4629-b5d1-54abacdd04ee None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:40.323340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1783a01a-e440-4629-b5d1-54abacdd04ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:40.332999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:40.399969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f33945-d5be-4090-aa42-00c41643e1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:40.401141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33945-d5be-4090-aa42-00c41643e1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.401430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33945-d5be-4090-aa42-00c41643e1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.401632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 194/386] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:40.401739 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f33945-d5be-4090-aa42-00c41643e1a8 None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.402845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f33945-d5be-4090-aa42-00c41643e1a8 None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:40.412358 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f33945-d5be-4090-aa42-00c41643e1a8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:40.412358 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 193/387] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:40 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:40.413651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a01a-e440-4629-b5d1-54abacdd04ee None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:40.597433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a01a-e440-4629-b5d1-54abacdd04ee None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:40.651069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe13ad-087b-48d2-a2c7-2fbc0550a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:40.651638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe13ad-087b-48d2-a2c7-2fbc0550a386 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.651923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe13ad-087b-48d2-a2c7-2fbc0550a386 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.652198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe13ad-087b-48d2-a2c7-2fbc0550a386 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.653392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe13ad-087b-48d2-a2c7-2fbc0550a386 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:40.654824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe13ad-087b-48d2-a2c7-2fbc0550a386 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:40.656483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 195/388] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:40 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:40.662180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f33945-d5be-4090-aa42-00c41643e1a8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:40.711593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe13ad-087b-48d2-a2c7-2fbc0550a386 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:40.727175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:40.841037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe13ad-087b-48d2-a2c7-2fbc0550a386 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:40.848851 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f33945-d5be-4090-aa42-00c41643e1a8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:40.867835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:40.888233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f215061-77b8-4a29-8a6d-8a582d1d8838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:40.888893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f215061-77b8-4a29-8a6d-8a582d1d8838 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.889174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f215061-77b8-4a29-8a6d-8a582d1d8838 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.889449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f215061-77b8-4a29-8a6d-8a582d1d8838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.892430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adbbd0-de61-48e5-9672-4f2f07f4ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:40.893092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adbbd0-de61-48e5-9672-4f2f07f4ce10 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.893372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adbbd0-de61-48e5-9672-4f2f07f4ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.893647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adbbd0-de61-48e5-9672-4f2f07f4ce10 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966/groups/d66234439c70410e990d0099f807ea2b/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.896195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adbbd0-de61-48e5-9672-4f2f07f4ce10 None admin] RBAC: Authorizing `identity:create_grant(project_id=16145402c02e4b02a32a9d3478528966, group_id=d66234439c70410e990d0099f807ea2b, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:40.897673 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adbbd0-de61-48e5-9672-4f2f07f4ce10 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:40.904665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f215061-77b8-4a29-8a6d-8a582d1d8838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-1f215061-77b8-4a29-8a6d-8a582d1d8838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:40.910092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:40.910967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:40.912090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 196/389] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:06:40.917660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8c82-398c-44d2-a4d4-14dd41150546 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.917660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8c82-398c-44d2-a4d4-14dd41150546 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.917660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8c82-398c-44d2-a4d4-14dd41150546 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.919156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 197/390] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:40.919156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff8c82-398c-44d2-a4d4-14dd41150546 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:40.971143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 194/391] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 10:06:40 2022] PUT /identity/v3/projects/16145402c02e4b02a32a9d3478528966/groups/d66234439c70410e990d0099f807ea2b/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:40.978069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcf7a-aeca-470f-8e2a-b1f47daa53ec None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:40.978869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcf7a-aeca-470f-8e2a-b1f47daa53ec None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:40.979259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dcf7a-aeca-470f-8e2a-b1f47daa53ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:40.995894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:41.024214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c04dcf7a-aeca-470f-8e2a-b1f47daa53ec None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:41.027526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c04dcf7a-aeca-470f-8e2a-b1f47daa53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:41.032145 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff8c82-398c-44d2-a4d4-14dd41150546 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:41.079983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39c7aa-73d3-439a-8f4c-ea1a07236623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:41.081930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c7aa-73d3-439a-8f4c-ea1a07236623 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.082398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c7aa-73d3-439a-8f4c-ea1a07236623 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.082848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c7aa-73d3-439a-8f4c-ea1a07236623 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.083715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39c7aa-73d3-439a-8f4c-ea1a07236623 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:41.084227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39c7aa-73d3-439a-8f4c-ea1a07236623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:41.085826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39c7aa-73d3-439a-8f4c-ea1a07236623 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:41.099982 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 198/392] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:41.102647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148875e8-6896-40ee-9a9d-a43b97e6a503 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.103875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148875e8-6896-40ee-9a9d-a43b97e6a503 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.104457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148875e8-6896-40ee-9a9d-a43b97e6a503 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.107057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 199/393] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:41.108167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148875e8-6896-40ee-9a9d-a43b97e6a503 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:41.123215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 195/394] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:41.127828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285542-5b2a-499e-aec4-a212136829ed None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.127828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285542-5b2a-499e-aec4-a212136829ed None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.127828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69285542-5b2a-499e-aec4-a212136829ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.149044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-69285542-5b2a-499e-aec4-a212136829ed None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:41.150343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-69285542-5b2a-499e-aec4-a212136829ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:41.233081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 196/395] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:41.249283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148875e8-6896-40ee-9a9d-a43b97e6a503 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:41.280546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:41.285348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8add9bc-8f95-4224-9191-6b83bf689f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:41.285987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add9bc-8f95-4224-9191-6b83bf689f93 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.286270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add9bc-8f95-4224-9191-6b83bf689f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.286544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add9bc-8f95-4224-9191-6b83bf689f93 None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.287645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8add9bc-8f95-4224-9191-6b83bf689f93 None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:41.289357 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8add9bc-8f95-4224-9191-6b83bf689f93 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:41.291851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 200/396] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:41 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:41.297614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285542-5b2a-499e-aec4-a212136829ed None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:41.355845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:41.413769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8add9bc-8f95-4224-9191-6b83bf689f93 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:41.441564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69285542-5b2a-499e-aec4-a212136829ed None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:41.513775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be626dd-f9e5-46fd-a0c6-35c77861907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:41.514339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be626dd-f9e5-46fd-a0c6-35c77861907e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.514621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be626dd-f9e5-46fd-a0c6-35c77861907e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.514896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be626dd-f9e5-46fd-a0c6-35c77861907e None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.516305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be626dd-f9e5-46fd-a0c6-35c77861907e None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:41.520701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be626dd-f9e5-46fd-a0c6-35c77861907e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:41.522350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 197/397] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:41 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:41.529406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be626dd-f9e5-46fd-a0c6-35c77861907e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:41.589237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8add9bc-8f95-4224-9191-6b83bf689f93 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:41.640192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1361d-eb73-46b5-b5cf-97ae17215c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:41.641123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1361d-eb73-46b5-b5cf-97ae17215c35 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.641451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1361d-eb73-46b5-b5cf-97ae17215c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.641890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1361d-eb73-46b5-b5cf-97ae17215c35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.656786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1361d-eb73-46b5-b5cf-97ae17215c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2ca1361d-eb73-46b5-b5cf-97ae17215c35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:41.663802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:41.664976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:41.666306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 201/398] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:41.668800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1361d-eb73-46b5-b5cf-97ae17215c35 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:41.691472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be626dd-f9e5-46fd-a0c6-35c77861907e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:41.701289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:41.742820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:41.747183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d03ba-eff1-4902-af43-e7266b198f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:41.748011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d03ba-eff1-4902-af43-e7266b198f4f None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.748315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d03ba-eff1-4902-af43-e7266b198f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.748633 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d03ba-eff1-4902-af43-e7266b198f4f None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966/groups/d66234439c70410e990d0099f807ea2b/roles/ca65b374d43c43aabe987aabb7147e99` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.750882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d03ba-eff1-4902-af43-e7266b198f4f None admin] RBAC: Authorizing `identity:create_grant(project_id=16145402c02e4b02a32a9d3478528966, group_id=d66234439c70410e990d0099f807ea2b, role_id=ca65b374d43c43aabe987aabb7147e99)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:41.752368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d03ba-eff1-4902-af43-e7266b198f4f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:41.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1361d-eb73-46b5-b5cf-97ae17215c35 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:41.824325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f0c02-2d42-41e2-a857-bee60d9c975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:41.824325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f0c02-2d42-41e2-a857-bee60d9c975b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.824325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f0c02-2d42-41e2-a857-bee60d9c975b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.824325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f0c02-2d42-41e2-a857-bee60d9c975b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.825336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 198/399] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 10:06:41 2022] PUT /identity/v3/projects/16145402c02e4b02a32a9d3478528966/groups/d66234439c70410e990d0099f807ea2b/roles/ca65b374d43c43aabe987aabb7147e99 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:41.826347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d03ba-eff1-4902-af43-e7266b198f4f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:41.839060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f0c02-2d42-41e2-a857-bee60d9c975b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-471f0c02-2d42-41e2-a857-bee60d9c975b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:41.844148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:41.845099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:41.845949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:41.850581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 202/400] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:41.852073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ea04-eaab-42a6-9ecb-ee13923d4603 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:41.852384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ea04-eaab-42a6-9ecb-ee13923d4603 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:41.852671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ea04-eaab-42a6-9ecb-ee13923d4603 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:41.855147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 203/401] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:41.855932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ea04-eaab-42a6-9ecb-ee13923d4603 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:41.969379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d03ba-eff1-4902-af43-e7266b198f4f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:41.976207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ea04-eaab-42a6-9ecb-ee13923d4603 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:41.999314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:42.010944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb4d2e-3508-4272-93f9-f2f00512e2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:42.011567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4d2e-3508-4272-93f9-f2f00512e2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.012937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4d2e-3508-4272-93f9-f2f00512e2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.012937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb4d2e-3508-4272-93f9-f2f00512e2a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.012937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb4d2e-3508-4272-93f9-f2f00512e2a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:42.013172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb4d2e-3508-4272-93f9-f2f00512e2a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:42.014556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:42.014695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb4d2e-3508-4272-93f9-f2f00512e2a7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:42.015284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.015632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.015973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.016981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:42.017161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:42.018632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:42.025804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 199/402] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:42.027049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd952f-90ac-4a77-bd87-691b33ef99da None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.027335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd952f-90ac-4a77-bd87-691b33ef99da None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.027614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd952f-90ac-4a77-bd87-691b33ef99da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.028988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 204/403] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:42.033750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:42.051528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-22bd952f-90ac-4a77-bd87-691b33ef99da None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:42.052882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-22bd952f-90ac-4a77-bd87-691b33ef99da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:42.082286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:42.134260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 200/404] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:42.139951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd952f-90ac-4a77-bd87-691b33ef99da None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:42.140204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529664af-4d5d-4cc6-9101-13fea261ab8e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:42.177069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62014199-8eb7-4c60-99a0-a99b0d3094de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:42.177844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014199-8eb7-4c60-99a0-a99b0d3094de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.178221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014199-8eb7-4c60-99a0-a99b0d3094de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.178597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62014199-8eb7-4c60-99a0-a99b0d3094de None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.179811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62014199-8eb7-4c60-99a0-a99b0d3094de None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:42.181458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62014199-8eb7-4c60-99a0-a99b0d3094de None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:42.183892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 205/405] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:42 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:42.193230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62014199-8eb7-4c60-99a0-a99b0d3094de None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:42.294200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:42.334543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd952f-90ac-4a77-bd87-691b33ef99da None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:42.385600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d8b5-80f3-42d3-9d9e-5ad2e96a102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:42.387319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d8b5-80f3-42d3-9d9e-5ad2e96a102d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.388862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d8b5-80f3-42d3-9d9e-5ad2e96a102d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.389284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d8b5-80f3-42d3-9d9e-5ad2e96a102d None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.391980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62014199-8eb7-4c60-99a0-a99b0d3094de None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:42.392740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044d8b5-80f3-42d3-9d9e-5ad2e96a102d None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:42.394350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044d8b5-80f3-42d3-9d9e-5ad2e96a102d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:42.402903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 201/406] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:42 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:42.403921 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d8b5-80f3-42d3-9d9e-5ad2e96a102d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:42.458938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:42.466598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf50ae-1cba-40b7-b771-5d3d5752e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:42.468152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf50ae-1cba-40b7-b771-5d3d5752e8ba None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.470514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf50ae-1cba-40b7-b771-5d3d5752e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.470514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf50ae-1cba-40b7-b771-5d3d5752e8ba None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.471004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf50ae-1cba-40b7-b771-5d3d5752e8ba None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:42.475221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf50ae-1cba-40b7-b771-5d3d5752e8ba None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:42.477102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 206/407] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:42 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:42.482887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf50ae-1cba-40b7-b771-5d3d5752e8ba None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:42.577191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d8b5-80f3-42d3-9d9e-5ad2e96a102d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:42.604563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf50ae-1cba-40b7-b771-5d3d5752e8ba None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:42.617400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361795c8-4d0a-4f9f-9990-ac95f26934fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:42.618175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361795c8-4d0a-4f9f-9990-ac95f26934fe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.618546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361795c8-4d0a-4f9f-9990-ac95f26934fe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.619532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361795c8-4d0a-4f9f-9990-ac95f26934fe None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.621304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361795c8-4d0a-4f9f-9990-ac95f26934fe None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:42.622809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361795c8-4d0a-4f9f-9990-ac95f26934fe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:42.627655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:42.629700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 202/408] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:42 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:42.630631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361795c8-4d0a-4f9f-9990-ac95f26934fe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:42.651411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793fec8-9131-4967-9388-5fc0f53eab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:42.652756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793fec8-9131-4967-9388-5fc0f53eab32 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.653199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793fec8-9131-4967-9388-5fc0f53eab32 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.653633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793fec8-9131-4967-9388-5fc0f53eab32 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed/groups/d66234439c70410e990d0099f807ea2b/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.658493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793fec8-9131-4967-9388-5fc0f53eab32 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9222a29dae64be382f46397d59deaed, group_id=d66234439c70410e990d0099f807ea2b, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:42.658493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793fec8-9131-4967-9388-5fc0f53eab32 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:42.735868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:42.742264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361795c8-4d0a-4f9f-9990-ac95f26934fe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:42.760326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 207/409] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 10:06:42 2022] PUT /identity/v3/projects/c9222a29dae64be382f46397d59deaed/groups/d66234439c70410e990d0099f807ea2b/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:42.760326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793fec8-9131-4967-9388-5fc0f53eab32 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:42.811173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e21c68-1c74-4297-bc95-a048cc2c3690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:42.811874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21c68-1c74-4297-bc95-a048cc2c3690 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:42.812188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21c68-1c74-4297-bc95-a048cc2c3690 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:42.812484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e21c68-1c74-4297-bc95-a048cc2c3690 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:42.837368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e21c68-1c74-4297-bc95-a048cc2c3690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-28e21c68-1c74-4297-bc95-a048cc2c3690 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:42.844679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:42.845689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:42.846501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 203/410] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:42.857803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e21c68-1c74-4297-bc95-a048cc2c3690 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:42.967485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793fec8-9131-4967-9388-5fc0f53eab32 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:43.012078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94676665-3113-4b2d-b5e8-a6e3662d5aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:43.012792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676665-3113-4b2d-b5e8-a6e3662d5aed None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.013069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676665-3113-4b2d-b5e8-a6e3662d5aed None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.013342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676665-3113-4b2d-b5e8-a6e3662d5aed None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed/groups/d66234439c70410e990d0099f807ea2b/roles/ca65b374d43c43aabe987aabb7147e99` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.016333 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94676665-3113-4b2d-b5e8-a6e3662d5aed None admin] RBAC: Authorizing `identity:create_grant(project_id=c9222a29dae64be382f46397d59deaed, group_id=d66234439c70410e990d0099f807ea2b, role_id=ca65b374d43c43aabe987aabb7147e99)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:43.017803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94676665-3113-4b2d-b5e8-a6e3662d5aed None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:43.030764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e21c68-1c74-4297-bc95-a048cc2c3690 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:43.071023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:43.072495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.073247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.073702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.074548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:43.075083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:43.076649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:43.085843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 204/411] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:43.092531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:43.101738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 208/412] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 10:06:42 2022] PUT /identity/v3/projects/c9222a29dae64be382f46397d59deaed/groups/d66234439c70410e990d0099f807ea2b/roles/ca65b374d43c43aabe987aabb7147e99 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:43.116045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c8097-8870-4495-bc18-a13880f324fc None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.116241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c8097-8870-4495-bc18-a13880f324fc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.116558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c8097-8870-4495-bc18-a13880f324fc None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.118116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 209/413] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:43.123917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b68d-b978-4959-8ccc-87cf1c0a640b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.124203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b68d-b978-4959-8ccc-87cf1c0a640b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.124527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b68d-b978-4959-8ccc-87cf1c0a640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.126602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:43.151957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0483b68d-b978-4959-8ccc-87cf1c0a640b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:43.153230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0483b68d-b978-4959-8ccc-87cf1c0a640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:43.214157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:43.288132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 210/414] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:43.296035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b1a14-ed33-481c-ac3b-37ac14697393 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:43.333079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95624ab-5076-43be-b2a6-95c1d9475400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:43.334060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95624ab-5076-43be-b2a6-95c1d9475400 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.334533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95624ab-5076-43be-b2a6-95c1d9475400 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.334995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95624ab-5076-43be-b2a6-95c1d9475400 None admin] PATH_INFO: `/v3/groups/31599ed9156540a2a03d0717b111a4c9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.336809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95624ab-5076-43be-b2a6-95c1d9475400 None admin] RBAC: Authorizing `identity:get_group(group_id=31599ed9156540a2a03d0717b111a4c9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:43.339440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95624ab-5076-43be-b2a6-95c1d9475400 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:43.341424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 205/415] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:43 2022] GET /identity/v3/groups/31599ed9156540a2a03d0717b111a4c9 => generated 229 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:43.347149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b68d-b978-4959-8ccc-87cf1c0a640b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:43.481524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483b68d-b978-4959-8ccc-87cf1c0a640b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:43.536628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab637cb-77b2-4c61-8c00-e39501ee4d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:43.538161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab637cb-77b2-4c61-8c00-e39501ee4d33 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.538665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab637cb-77b2-4c61-8c00-e39501ee4d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.539393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab637cb-77b2-4c61-8c00-e39501ee4d33 None admin] PATH_INFO: `/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.541575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab637cb-77b2-4c61-8c00-e39501ee4d33 None admin] RBAC: Authorizing `identity:get_project(project_id=86f5f0c06d84427a9264fb27dee1d3a9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:43.543449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab637cb-77b2-4c61-8c00-e39501ee4d33 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:43.545643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 211/416] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:43 2022] GET /identity/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:43.551460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95624ab-5076-43be-b2a6-95c1d9475400 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:43.611124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab637cb-77b2-4c61-8c00-e39501ee4d33 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:43.649026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:43.692248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:43.726548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95624ab-5076-43be-b2a6-95c1d9475400 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:43.750110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab637cb-77b2-4c61-8c00-e39501ee4d33 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:43.787782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01b46d-d15c-4ab6-85e8-d5d55fec384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:43.788886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b46d-d15c-4ab6-85e8-d5d55fec384a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.789631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b46d-d15c-4ab6-85e8-d5d55fec384a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.790295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b46d-d15c-4ab6-85e8-d5d55fec384a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.802358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01b46d-d15c-4ab6-85e8-d5d55fec384a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ca01b46d-d15c-4ab6-85e8-d5d55fec384a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:43.808689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:43.809638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:43.810485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:43.816835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 212/417] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:43.819300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01b46d-d15c-4ab6-85e8-d5d55fec384a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:43.836213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb634-0b53-425d-b85d-b7485ae899e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:43.838951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb634-0b53-425d-b85d-b7485ae899e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.839243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb634-0b53-425d-b85d-b7485ae899e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.844325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb634-0b53-425d-b85d-b7485ae899e6 None admin] PATH_INFO: `/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9/groups/31599ed9156540a2a03d0717b111a4c9/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.844325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eb634-0b53-425d-b85d-b7485ae899e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=86f5f0c06d84427a9264fb27dee1d3a9, group_id=31599ed9156540a2a03d0717b111a4c9, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:43.846479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eb634-0b53-425d-b85d-b7485ae899e6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:43.924824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 206/418] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 28 10:06:43 2022] PUT /identity/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9/groups/31599ed9156540a2a03d0717b111a4c9/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:06:43.931111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3929c6c-82ea-477d-b6db-55bf76f6e22b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.931111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3929c6c-82ea-477d-b6db-55bf76f6e22b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.931111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3929c6c-82ea-477d-b6db-55bf76f6e22b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.932423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 207/419] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:43.935440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005c10-6db7-485b-9e19-d810bccba6e0 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:43.935722 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005c10-6db7-485b-9e19-d810bccba6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:43.935992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005c10-6db7-485b-9e19-d810bccba6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:43.941660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:43.953367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01b46d-d15c-4ab6-85e8-d5d55fec384a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:43.956420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-13005c10-6db7-485b-9e19-d810bccba6e0 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:43.958313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-13005c10-6db7-485b-9e19-d810bccba6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:44.027131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:44.027671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:44.027954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:44.028231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:44.028941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:44.029246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:44.032242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:44.061376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 213/420] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:44.070392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:44.102259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 208/421] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:44.203431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560e2b-6696-4a65-8211-1d0b8934f023 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:44.239229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08f4ee-9a7c-4abc-9787-e5d09afcd636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:44.240192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08f4ee-9a7c-4abc-9787-e5d09afcd636 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:44.240709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08f4ee-9a7c-4abc-9787-e5d09afcd636 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:44.241197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08f4ee-9a7c-4abc-9787-e5d09afcd636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:44.283624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:44.340939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08f4ee-9a7c-4abc-9787-e5d09afcd636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:44.342402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08f4ee-9a7c-4abc-9787-e5d09afcd636 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:44.389789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13005c10-6db7-485b-9e19-d810bccba6e0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:44.460642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 214/422] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 10:06:44.467924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08f4ee-9a7c-4abc-9787-e5d09afcd636 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:44.535327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:44.577494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:44.588473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08f4ee-9a7c-4abc-9787-e5d09afcd636 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:44.623968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13005c10-6db7-485b-9e19-d810bccba6e0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:44.626191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad86fa2-2fa9-49ea-a980-0e32f98138d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:44.626831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad86fa2-2fa9-49ea-a980-0e32f98138d9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:44.627113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad86fa2-2fa9-49ea-a980-0e32f98138d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:44.627389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad86fa2-2fa9-49ea-a980-0e32f98138d9 None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:44.628600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad86fa2-2fa9-49ea-a980-0e32f98138d9 None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:44.630088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad86fa2-2fa9-49ea-a980-0e32f98138d9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:44.631724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 215/423] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:44 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:44.637351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad86fa2-2fa9-49ea-a980-0e32f98138d9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:44.700819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20ffc3-e484-43f7-bded-dc03b34ed54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:44.701819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ffc3-e484-43f7-bded-dc03b34ed54c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:44.702296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ffc3-e484-43f7-bded-dc03b34ed54c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:44.702786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20ffc3-e484-43f7-bded-dc03b34ed54c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:44.725489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20ffc3-e484-43f7-bded-dc03b34ed54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-9b20ffc3-e484-43f7-bded-dc03b34ed54c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:44.731265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:44.732167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:44.733001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:44.740741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 209/424] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:44.753668 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20ffc3-e484-43f7-bded-dc03b34ed54c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:44.754675 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad86fa2-2fa9-49ea-a980-0e32f98138d9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:44.782896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:44.800177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a79fd0-2336-4ec7-b653-882f36904e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:44.800177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a79fd0-2336-4ec7-b653-882f36904e14 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:44.800177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a79fd0-2336-4ec7-b653-882f36904e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:44.800177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a79fd0-2336-4ec7-b653-882f36904e14 None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:44.800576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a79fd0-2336-4ec7-b653-882f36904e14 None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:44.800576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a79fd0-2336-4ec7-b653-882f36904e14 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:44.800576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 216/425] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:44 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:44.803876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a79fd0-2336-4ec7-b653-882f36904e14 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:44.912771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a79fd0-2336-4ec7-b653-882f36904e14 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:44.949845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:44.950461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:44.950742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:44.951017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:44.951757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] RBAC: Adding query filter params (group.id=d66234439c70410e990d0099f807ea2b, role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=16145402c02e4b02a32a9d3478528966) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:44.952068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:44.953954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:44.960235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 217/426] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:44 2022] GET /identity/v3/role_assignments?group.id=d66234439c70410e990d0099f807ea2b&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:44.998580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20ffc3-e484-43f7-bded-dc03b34ed54c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:45.056894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e2b7c-d78c-4d34-bc86-14d73c34b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:45.057398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2b7c-d78c-4d34-bc86-14d73c34b64a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.057675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2b7c-d78c-4d34-bc86-14d73c34b64a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.057945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e2b7c-d78c-4d34-bc86-14d73c34b64a None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.058621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e2b7c-d78c-4d34-bc86-14d73c34b64a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:45.058924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e2b7c-d78c-4d34-bc86-14d73c34b64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:45.060319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e2b7c-d78c-4d34-bc86-14d73c34b64a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:45.061788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:45.072833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 210/427] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:45.076201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:45.144527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:45.190717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9027fd9-64f9-4817-9cc2-49d44eda9eba None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:45.227814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc613c5-d1c6-464c-81e2-416a904c5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:45.229140 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc613c5-d1c6-464c-81e2-416a904c5636 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.229422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc613c5-d1c6-464c-81e2-416a904c5636 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.229698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc613c5-d1c6-464c-81e2-416a904c5636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.248056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf829ab-cdf3-46ad-a251-ca225db64d46 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.248377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf829ab-cdf3-46ad-a251-ca225db64d46 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.248634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf829ab-cdf3-46ad-a251-ca225db64d46 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.250116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 211/428] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:45.255665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270d945-999c-4969-aa68-bf0155cfc714 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.255957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270d945-999c-4969-aa68-bf0155cfc714 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.256315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270d945-999c-4969-aa68-bf0155cfc714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.286614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d270d945-999c-4969-aa68-bf0155cfc714 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:45.291141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d270d945-999c-4969-aa68-bf0155cfc714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:45.312833 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc613c5-d1c6-464c-81e2-416a904c5636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:45.314375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc613c5-d1c6-464c-81e2-416a904c5636 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:45.381066 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 212/429] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:45.386314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:45.435834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 218/430] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:45.441623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270d945-999c-4969-aa68-bf0155cfc714 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:45.548584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270d945-999c-4969-aa68-bf0155cfc714 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:45.576086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:45.585857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda0951-0c9f-4475-9f17-8bd07a37e89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:45.586744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda0951-0c9f-4475-9f17-8bd07a37e89a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.587234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda0951-0c9f-4475-9f17-8bd07a37e89a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.588387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda0951-0c9f-4475-9f17-8bd07a37e89a None admin] PATH_INFO: `/v3/projects/16145402c02e4b02a32a9d3478528966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.589953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda0951-0c9f-4475-9f17-8bd07a37e89a None admin] RBAC: Authorizing `identity:get_project(project_id=16145402c02e4b02a32a9d3478528966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:45.591641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda0951-0c9f-4475-9f17-8bd07a37e89a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:45.593785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 213/431] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:45 2022] GET /identity/v3/projects/16145402c02e4b02a32a9d3478528966 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:45.599462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc613c5-d1c6-464c-81e2-416a904c5636 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:45.696916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda0951-0c9f-4475-9f17-8bd07a37e89a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:45.709205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc613c5-d1c6-464c-81e2-416a904c5636 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:45.746715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2960f-c434-40b0-9b1f-88a582eb39a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:45.748046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2960f-c434-40b0-9b1f-88a582eb39a4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.748596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2960f-c434-40b0-9b1f-88a582eb39a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.749096 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2960f-c434-40b0-9b1f-88a582eb39a4 None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.750434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2960f-c434-40b0-9b1f-88a582eb39a4 None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:45.752081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2960f-c434-40b0-9b1f-88a582eb39a4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:45.754239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 219/432] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:45 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:45.755564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f080-2bb3-4905-be41-6c13ed40227c None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.756113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f080-2bb3-4905-be41-6c13ed40227c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.756622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5f080-2bb3-4905-be41-6c13ed40227c None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.758296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 220/433] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:45.761035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5f080-2bb3-4905-be41-6c13ed40227c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:45.801592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:45.818208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda0951-0c9f-4475-9f17-8bd07a37e89a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:45.868226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44a04a-21b9-4728-ae4e-c6f28be7c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:45.869774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44a04a-21b9-4728-ae4e-c6f28be7c635 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.870074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44a04a-21b9-4728-ae4e-c6f28be7c635 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.870344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44a04a-21b9-4728-ae4e-c6f28be7c635 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.888548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44a04a-21b9-4728-ae4e-c6f28be7c635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5a44a04a-21b9-4728-ae4e-c6f28be7c635 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:45.894918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:45.895976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:45.897068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 214/434] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:45.897983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5f080-2bb3-4905-be41-6c13ed40227c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:45.898096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09642a03-56ee-4f94-bf09-3bf5737283d4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.898302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09642a03-56ee-4f94-bf09-3bf5737283d4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.898581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09642a03-56ee-4f94-bf09-3bf5737283d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.924589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-09642a03-56ee-4f94-bf09-3bf5737283d4 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:45.926608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-09642a03-56ee-4f94-bf09-3bf5737283d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:45.938583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:45.939194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:45.939479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:45.939754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:45.940525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] RBAC: Adding query filter params (group.id=d66234439c70410e990d0099f807ea2b, role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=16145402c02e4b02a32a9d3478528966) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:45.940836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:45.942330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:45.948901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 221/435] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:45 2022] GET /identity/v3/role_assignments?group.id=d66234439c70410e990d0099f807ea2b&scope.project.id=16145402c02e4b02a32a9d3478528966&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:45.949694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.017849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:46.051604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 215/436] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:46.062881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:46.075839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a315-6f57-47b6-a1cd-e98f014cb746 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.115267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb5da-fbee-4404-ad45-7198190fcae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:46.115883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb5da-fbee-4404-ad45-7198190fcae7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.116738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb5da-fbee-4404-ad45-7198190fcae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.116738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb5da-fbee-4404-ad45-7198190fcae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.117246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb5da-fbee-4404-ad45-7198190fcae7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:46.117559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb5da-fbee-4404-ad45-7198190fcae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:46.119524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bb5da-fbee-4404-ad45-7198190fcae7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:46.130739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 222/437] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:06:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:46.136675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09642a03-56ee-4f94-bf09-3bf5737283d4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.244919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09642a03-56ee-4f94-bf09-3bf5737283d4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.281746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dbcdd-eced-488e-bd0e-9847fd93a712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:46.282361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dbcdd-eced-488e-bd0e-9847fd93a712 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.282640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dbcdd-eced-488e-bd0e-9847fd93a712 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.282911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42dbcdd-eced-488e-bd0e-9847fd93a712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.286276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae406bd2-909f-49bd-b65e-ecfe0d3ce2aa None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.286562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae406bd2-909f-49bd-b65e-ecfe0d3ce2aa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.286836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae406bd2-909f-49bd-b65e-ecfe0d3ce2aa None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.289677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 223/438] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:46.294516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27eb63-95ba-4d7e-8ca8-f380492900e0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.294799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27eb63-95ba-4d7e-8ca8-f380492900e0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.295081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27eb63-95ba-4d7e-8ca8-f380492900e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.315456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bf27eb63-95ba-4d7e-8ca8-f380492900e0 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:46.316704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bf27eb63-95ba-4d7e-8ca8-f380492900e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:46.344686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:46.361273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42dbcdd-eced-488e-bd0e-9847fd93a712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:46.362805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42dbcdd-eced-488e-bd0e-9847fd93a712 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:46.397060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 224/439] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:46.398191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27eb63-95ba-4d7e-8ca8-f380492900e0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.475344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 216/440] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:46.476402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dbcdd-eced-488e-bd0e-9847fd93a712 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.484545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:46.502215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27eb63-95ba-4d7e-8ca8-f380492900e0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.540108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567df95-6645-40d2-90de-6fe387d4d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:46.541314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567df95-6645-40d2-90de-6fe387d4d92a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.541763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567df95-6645-40d2-90de-6fe387d4d92a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.542044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567df95-6645-40d2-90de-6fe387d4d92a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.554466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567df95-6645-40d2-90de-6fe387d4d92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e567df95-6645-40d2-90de-6fe387d4d92a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:46.560790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:46.561717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:46.562540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 225/441] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:46.565018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:46.569088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567df95-6645-40d2-90de-6fe387d4d92a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.577473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42dbcdd-eced-488e-bd0e-9847fd93a712 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.612782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e38491-6ab9-41e7-ba12-30afc9db1233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:46.613408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38491-6ab9-41e7-ba12-30afc9db1233 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.613711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38491-6ab9-41e7-ba12-30afc9db1233 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.613988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e38491-6ab9-41e7-ba12-30afc9db1233 None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.615121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e38491-6ab9-41e7-ba12-30afc9db1233 None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:46.616601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e38491-6ab9-41e7-ba12-30afc9db1233 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:46.618542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 217/442] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:46 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:46.624918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e38491-6ab9-41e7-ba12-30afc9db1233 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.679601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567df95-6645-40d2-90de-6fe387d4d92a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.714083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:46.714682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.714962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.715235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.715902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:46.716203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:46.717608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:46.725365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 226/443] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:46.726270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.730810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e38491-6ab9-41e7-ba12-30afc9db1233 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.731161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:46.764019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31f09a-ea40-4d2c-983e-066a6c6dce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:46.764665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31f09a-ea40-4d2c-983e-066a6c6dce45 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.764943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31f09a-ea40-4d2c-983e-066a6c6dce45 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.765211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31f09a-ea40-4d2c-983e-066a6c6dce45 None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.766304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31f09a-ea40-4d2c-983e-066a6c6dce45 None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:46.767742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31f09a-ea40-4d2c-983e-066a6c6dce45 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:46.769480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 218/444] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:46 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:46.770129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31f09a-ea40-4d2c-983e-066a6c6dce45 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.792894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:46.830070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad1900-737b-4c7e-96ba-e7971e2f9310 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.863375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2e94c-6eb9-48af-9512-fc97f9c428a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:46.864011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e94c-6eb9-48af-9512-fc97f9c428a2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.864305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e94c-6eb9-48af-9512-fc97f9c428a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.864594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2e94c-6eb9-48af-9512-fc97f9c428a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.870269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31f09a-ea40-4d2c-983e-066a6c6dce45 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.874554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2e94c-6eb9-48af-9512-fc97f9c428a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-73a2e94c-6eb9-48af-9512-fc97f9c428a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:46.879930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:46.881074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 227/445] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:46.881962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2e94c-6eb9-48af-9512-fc97f9c428a2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:46.908669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f5bd-3252-4963-b5d0-0af7e10b40ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:46.909268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5bd-3252-4963-b5d0-0af7e10b40ef None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:46.909550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5bd-3252-4963-b5d0-0af7e10b40ef None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:46.909822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5bd-3252-4963-b5d0-0af7e10b40ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:46.942762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:46.976093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857f5bd-3252-4963-b5d0-0af7e10b40ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:46.977587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857f5bd-3252-4963-b5d0-0af7e10b40ef None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:46.980557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2e94c-6eb9-48af-9512-fc97f9c428a2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:46.997349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:47.014105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.014715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.014997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.015276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.016003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] RBAC: Adding query filter params (group.id=d66234439c70410e990d0099f807ea2b, role.id=983dd1ee6dee498dac7c66c3c5a68bc7, scope.project.id=c9222a29dae64be382f46397d59deaed) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:47.016337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.017772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.023413 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 228/446] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:46 2022] GET /identity/v3/role_assignments?group.id=d66234439c70410e990d0099f807ea2b&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=983dd1ee6dee498dac7c66c3c5a68bc7 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:47.024201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:47.088350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 219/447] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:47.091851 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f5bd-3252-4963-b5d0-0af7e10b40ef None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:47.151192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8a588-98d7-4958-b204-fb4d6ee74a81 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:47.183409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:47.197345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.198149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.198303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.198553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.199236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:47.199541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.200958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.209467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f5bd-3252-4963-b5d0-0af7e10b40ef None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:47.210875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 229/448] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:47.217786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:47.236934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:47.258268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84d31f-b0c3-47e5-aaa8-d0a21f1437aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.258898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d31f-b0c3-47e5-aaa8-d0a21f1437aa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.260339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d31f-b0c3-47e5-aaa8-d0a21f1437aa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.260339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84d31f-b0c3-47e5-aaa8-d0a21f1437aa None admin] PATH_INFO: `/v3/projects/c9222a29dae64be382f46397d59deaed` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.261085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84d31f-b0c3-47e5-aaa8-d0a21f1437aa None admin] RBAC: Authorizing `identity:get_project(project_id=c9222a29dae64be382f46397d59deaed)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.262150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84d31f-b0c3-47e5-aaa8-d0a21f1437aa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.263938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 220/449] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:47 2022] GET /identity/v3/projects/c9222a29dae64be382f46397d59deaed => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:47.269322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84d31f-b0c3-47e5-aaa8-d0a21f1437aa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:47.329656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486bcbe-a700-43e8-9513-43fc69b04553 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:47.370324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1e245-894c-41dc-aa04-73a64ddb648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.370943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e245-894c-41dc-aa04-73a64ddb648d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.371223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e245-894c-41dc-aa04-73a64ddb648d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.371500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1e245-894c-41dc-aa04-73a64ddb648d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.392713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84d31f-b0c3-47e5-aaa8-d0a21f1437aa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:47.426194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37442fe1-ef46-4b64-a00d-f9f61b0930c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.426814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442fe1-ef46-4b64-a00d-f9f61b0930c6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.427092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442fe1-ef46-4b64-a00d-f9f61b0930c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.427364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37442fe1-ef46-4b64-a00d-f9f61b0930c6 None admin] PATH_INFO: `/v3/groups/d66234439c70410e990d0099f807ea2b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.428504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37442fe1-ef46-4b64-a00d-f9f61b0930c6 None admin] RBAC: Authorizing `identity:get_group(group_id=d66234439c70410e990d0099f807ea2b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.429953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37442fe1-ef46-4b64-a00d-f9f61b0930c6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.430919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:47.432086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 221/450] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:47 2022] GET /identity/v3/groups/d66234439c70410e990d0099f807ea2b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:47.437930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37442fe1-ef46-4b64-a00d-f9f61b0930c6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:47.442244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1e245-894c-41dc-aa04-73a64ddb648d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.443800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1e245-894c-41dc-aa04-73a64ddb648d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.492984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:47.539124 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37442fe1-ef46-4b64-a00d-f9f61b0930c6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:47.544447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 230/451] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:47.550149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1e245-894c-41dc-aa04-73a64ddb648d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:47.573784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.574388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.574670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.574946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.575678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] RBAC: Adding query filter params (group.id=d66234439c70410e990d0099f807ea2b, role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=c9222a29dae64be382f46397d59deaed) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:47.575990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.577472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.583063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 222/452] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:47 2022] GET /identity/v3/role_assignments?group.id=d66234439c70410e990d0099f807ea2b&scope.project.id=c9222a29dae64be382f46397d59deaed&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:47.643427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:47.653036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1e245-894c-41dc-aa04-73a64ddb648d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:47.689667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95614-6358-49ab-81e8-b0cc61d368ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.690375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95614-6358-49ab-81e8-b0cc61d368ad None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.690586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95614-6358-49ab-81e8-b0cc61d368ad None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.690864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95614-6358-49ab-81e8-b0cc61d368ad None admin] PATH_INFO: `/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.692042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95614-6358-49ab-81e8-b0cc61d368ad None admin] RBAC: Authorizing `identity:get_project(project_id=86f5f0c06d84427a9264fb27dee1d3a9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.693533 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95614-6358-49ab-81e8-b0cc61d368ad None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.695185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 231/453] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:06:47 2022] GET /identity/v3/projects/86f5f0c06d84427a9264fb27dee1d3a9 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:47.700924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:47.802498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf725568-69f1-4b4e-8e1b-2a7ad2fb05e7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:47.822938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:47.836468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9c697-b464-434c-b542-297029a45ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.837112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9c697-b464-434c-b542-297029a45ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.837437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9c697-b464-434c-b542-297029a45ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.837910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9c697-b464-434c-b542-297029a45ba2 None admin] PATH_INFO: `/v3/groups/31599ed9156540a2a03d0717b111a4c9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.839050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9c697-b464-434c-b542-297029a45ba2 None admin] RBAC: Authorizing `identity:get_group(group_id=31599ed9156540a2a03d0717b111a4c9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.840562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9c697-b464-434c-b542-297029a45ba2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.844610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 223/454] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 28 10:06:47 2022] GET /identity/v3/groups/31599ed9156540a2a03d0717b111a4c9 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:47.848040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95614-6358-49ab-81e8-b0cc61d368ad None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:47.948442 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95614-6358-49ab-81e8-b0cc61d368ad None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:47.981579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d9657-3689-4419-84bd-8a43633b08b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:47.982201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d9657-3689-4419-84bd-8a43633b08b6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:47.982482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d9657-3689-4419-84bd-8a43633b08b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:47.982752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d9657-3689-4419-84bd-8a43633b08b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:47.983475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d9657-3689-4419-84bd-8a43633b08b6 None admin] RBAC: Adding query filter params (group.id=31599ed9156540a2a03d0717b111a4c9, role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=86f5f0c06d84427a9264fb27dee1d3a9) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:47.983813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d9657-3689-4419-84bd-8a43633b08b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:47.985260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d9657-3689-4419-84bd-8a43633b08b6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:47.990813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 232/455] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 28 10:06:47 2022] GET /identity/v3/role_assignments?group.id=31599ed9156540a2a03d0717b111a4c9&scope.project.id=86f5f0c06d84427a9264fb27dee1d3a9&role.id=fe95a036fa044c4bb408b793fba6436a => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:50.495804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58487-c29c-4a19-ae35-5df84c4e6195 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:50.496370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58487-c29c-4a19-ae35-5df84c4e6195 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:50.496370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58487-c29c-4a19-ae35-5df84c4e6195 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:50.497855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 224/456] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:50.503332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef6f31-cbc0-4c7d-bb0d-9c304f4bd0e9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:50.503741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef6f31-cbc0-4c7d-bb0d-9c304f4bd0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:50.503906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef6f31-cbc0-4c7d-bb0d-9c304f4bd0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:50.541308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-18ef6f31-cbc0-4c7d-bb0d-9c304f4bd0e9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:50.542586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-18ef6f31-cbc0-4c7d-bb0d-9c304f4bd0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:50.565351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:50.668749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b270-d4ba-40ac-b178-b368817dd94a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:50.669066 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b270-d4ba-40ac-b178-b368817dd94a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:50.669305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096b270-d4ba-40ac-b178-b368817dd94a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:50.670776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 225/457] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:50.674871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 233/458] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:50.676140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ee91-b563-481e-872e-0c7d8787b355 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:50.676392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ee91-b563-481e-872e-0c7d8787b355 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:50.676672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ee91-b563-481e-872e-0c7d8787b355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:50.709877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7bf3ee91-b563-481e-872e-0c7d8787b355 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:50.717945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7bf3ee91-b563-481e-872e-0c7d8787b355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:50.732789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177eaa4-b0d7-4964-b08c-1fa12d6f6fb7 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:50.733083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177eaa4-b0d7-4964-b08c-1fa12d6f6fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:50.733347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177eaa4-b0d7-4964-b08c-1fa12d6f6fb7 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:50.734979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 234/459] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:50.739956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24db36-a45f-4420-88c7-8cdf07fea270 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:50.740244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24db36-a45f-4420-88c7-8cdf07fea270 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:50.740566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24db36-a45f-4420-88c7-8cdf07fea270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:50.770586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ac24db36-a45f-4420-88c7-8cdf07fea270 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:50.771690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac24db36-a45f-4420-88c7-8cdf07fea270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:50.934951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 226/460] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:50.957811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 235/461] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:51.017886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3ee91-b563-481e-872e-0c7d8787b355 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:51.135505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3ee91-b563-481e-872e-0c7d8787b355 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:51.154567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:51.177565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fa9f2-417a-4a96-91b2-a451c4c32ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:51.178208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fa9f2-417a-4a96-91b2-a451c4c32ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.178483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fa9f2-417a-4a96-91b2-a451c4c32ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.178750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fa9f2-417a-4a96-91b2-a451c4c32ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.189222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fa9f2-417a-4a96-91b2-a451c4c32ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:51.190688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fa9f2-417a-4a96-91b2-a451c4c32ae5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3c5fa9f2-417a-4a96-91b2-a451c4c32ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:51.209343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:51.210299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:51.211170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:51.211170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:51.211170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:51.211756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 227/462] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:06:51.221550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24db36-a45f-4420-88c7-8cdf07fea270 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:51.223308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad4a3-e54d-446d-b8a0-ac3c227b70f2 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.223595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad4a3-e54d-446d-b8a0-ac3c227b70f2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.223873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad4a3-e54d-446d-b8a0-ac3c227b70f2 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.225197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 228/463] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:51.238527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad135-fbac-4a2c-87e5-27e2356e0187 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.238811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad135-fbac-4a2c-87e5-27e2356e0187 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.239086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ad135-fbac-4a2c-87e5-27e2356e0187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.259510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-226ad135-fbac-4a2c-87e5-27e2356e0187 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:51.260736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-226ad135-fbac-4a2c-87e5-27e2356e0187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:51.312671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:51.332059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24db36-a45f-4420-88c7-8cdf07fea270 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:51.341496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 229/464] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:51.342422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ad135-fbac-4a2c-87e5-27e2356e0187 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:51.379141 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:51.379832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.380180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.380751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.382329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:51.382701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:51.384850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:51.401772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 236/465] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:51.402802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:51.450717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:51.453710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ad135-fbac-4a2c-87e5-27e2356e0187 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:51.492090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:51.493102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.493664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.494006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.505008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:51.506775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:51.523762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:51.524814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:51.525682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:51.525682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:51.525682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:51.527546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 230/466] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:51.527745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e57ba1-f97e-42ca-9339-bcaf0621454c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:51.530248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:51.577385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:51.578017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.578296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.578565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.593288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:51.595017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:51.597426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:51.615425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:51.616426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:51.617787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:51.617787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:51.617787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:51.617787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 237/467] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:51.618003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:51.646666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d8942-717d-455d-b0a2-2817c3759f4e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:51.682798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ec71-6499-4097-b586-469722ee9dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:51.683327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ec71-6499-4097-b586-469722ee9dab None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.683603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ec71-6499-4097-b586-469722ee9dab None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.683873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ec71-6499-4097-b586-469722ee9dab None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.684548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461ec71-6499-4097-b586-469722ee9dab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:51.685984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461ec71-6499-4097-b586-469722ee9dab None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:51.729873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce126-e9fc-4471-b496-f2a7d7b65488 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:51.763846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:51.764484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.764768 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.765038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.765675 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:51.765974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:51.767334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:51.779268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 238/468] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:51.781070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:51.787123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 231/469] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:51 2022] POST /identity/v3/users => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:51.787995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ec71-6499-4097-b586-469722ee9dab None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:51.809447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:51.864514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:51.926210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443e620-754b-438b-b01a-ebd8c0f99c31 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:51.938423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ec71-6499-4097-b586-469722ee9dab None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:51.966973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:51.967584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.967863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.968128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.968806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:51.969105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:51.970503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:51.982852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8908888-ba47-4033-83ba-c23e425619f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:51.982852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8908888-ba47-4033-83ba-c23e425619f2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:51.982852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8908888-ba47-4033-83ba-c23e425619f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:51.982852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8908888-ba47-4033-83ba-c23e425619f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:51.983235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 239/470] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:51.984317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:52.002607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8908888-ba47-4033-83ba-c23e425619f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:52.004538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8908888-ba47-4033-83ba-c23e425619f2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a8908888-ba47-4033-83ba-c23e425619f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:52.019552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:52.020580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:52.021430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:52.021430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:52.021430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:52.021430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 232/471] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:52.022180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7050-7316-402e-9d23-f0f5beef957e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:52.022180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7050-7316-402e-9d23-f0f5beef957e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:52.022425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7050-7316-402e-9d23-f0f5beef957e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:52.023716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 233/472] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:52.024247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a7050-7316-402e-9d23-f0f5beef957e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:52.093303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:52.102889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06597d7-5290-4913-a308-8702c285f888 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:52.117744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:52.138166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a7050-7316-402e-9d23-f0f5beef957e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:52.138346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc8041-9465-4e66-b512-2494847e905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:52.138818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8041-9465-4e66-b512-2494847e905f None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:52.139104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8041-9465-4e66-b512-2494847e905f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:52.139380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc8041-9465-4e66-b512-2494847e905f None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:52.140041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc8041-9465-4e66-b512-2494847e905f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:52.141511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc8041-9465-4e66-b512-2494847e905f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:52.174160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47494c6-9889-4832-90bd-dcd9dcf24272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:52.174770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47494c6-9889-4832-90bd-dcd9dcf24272 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:52.175055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47494c6-9889-4832-90bd-dcd9dcf24272 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:52.175330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47494c6-9889-4832-90bd-dcd9dcf24272 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:52.175995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47494c6-9889-4832-90bd-dcd9dcf24272 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:52.177485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47494c6-9889-4832-90bd-dcd9dcf24272 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:52.244000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 240/473] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:51 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:52.245253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa1cd3-ae3a-461e-92de-e3bebf704de1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:52.245545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa1cd3-ae3a-461e-92de-e3bebf704de1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:52.245821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa1cd3-ae3a-461e-92de-e3bebf704de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:52.269595 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-96fa1cd3-ae3a-461e-92de-e3bebf704de1 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:52.270895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-96fa1cd3-ae3a-461e-92de-e3bebf704de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:52.272709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 234/474] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:52 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:52.278246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47494c6-9889-4832-90bd-dcd9dcf24272 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:52.428105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 241/475] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:52.461219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47494c6-9889-4832-90bd-dcd9dcf24272 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:52.482209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:52.504493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:52.505035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:52.505575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:52.505648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:52.506277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:52.506578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:52.507953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:52.528429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 235/476] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:52.533778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa1cd3-ae3a-461e-92de-e3bebf704de1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:52.645491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:52.648991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa1cd3-ae3a-461e-92de-e3bebf704de1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:52.686665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d462f4-b63d-4d99-9791-5f24049a1abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:52.687275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d462f4-b63d-4d99-9791-5f24049a1abb None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:52.687552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d462f4-b63d-4d99-9791-5f24049a1abb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:52.687822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d462f4-b63d-4d99-9791-5f24049a1abb None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:52.688508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d462f4-b63d-4d99-9791-5f24049a1abb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:52.690046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d462f4-b63d-4d99-9791-5f24049a1abb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:52.743913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:52.791492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 242/477] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:52 2022] POST /identity/v3/users => generated 249 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:52.856115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ff4ea-e8fe-4ebc-bf99-d5b20405ef6f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:52.896443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:52.897055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:52.897331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:52.897602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:52.898302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:52.900411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:52.947510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.sql.core [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 10:06:52.947510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 10:06:52.947510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [parameters: {'id': 'a46cd64648214ec9b784a5f7d76f8bb4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 10:06:52.947510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81597) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Aug 28 10:06:52.967876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return ref.to_dict() Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 10:06:52.968838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application yield resource Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise self.value Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application session.commit() Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 10:06:52.969759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.flush() Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application compat.raise_( Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 10:06:52.971849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 10:06:52.974042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 10:06:52.976027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [parameters: {'id': 'a46cd64648214ec9b784a5f7d76f8bb4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:52.978286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 10:06:52.980443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:52.982532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 236/478] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 10:06:52 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:06:52.982673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d462f4-b63d-4d99-9791-5f24049a1abb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:53.110510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d462f4-b63d-4d99-9791-5f24049a1abb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:53.145326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835749e6-691c-4820-986b-b07f03d7c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:53.145961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835749e6-691c-4820-986b-b07f03d7c458 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:53.146233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835749e6-691c-4820-986b-b07f03d7c458 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:53.146503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835749e6-691c-4820-986b-b07f03d7c458 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:53.157408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835749e6-691c-4820-986b-b07f03d7c458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-835749e6-691c-4820-986b-b07f03d7c458 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:53.162918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:53.165840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 10:06:53.167796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:53.169377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 243/479] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:06:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:53.172325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:53.222671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:53.286942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0fdc-e773-42b5-adb1-64a88b58ebba None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:53.324741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee034e-f32f-4d8b-ad57-fcfc929043bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:53.325354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee034e-f32f-4d8b-ad57-fcfc929043bd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:53.325628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee034e-f32f-4d8b-ad57-fcfc929043bd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:53.325898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee034e-f32f-4d8b-ad57-fcfc929043bd None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:53.326569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee034e-f32f-4d8b-ad57-fcfc929043bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:53.326925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee034e-f32f-4d8b-ad57-fcfc929043bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:53.328385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee034e-f32f-4d8b-ad57-fcfc929043bd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:53.337718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 237/480] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:53.934103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7a77-026d-47b2-9692-361e18eec8b1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:53.934794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7a77-026d-47b2-9692-361e18eec8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:53.934794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c7a77-026d-47b2-9692-361e18eec8b1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:53.936218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 244/481] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:53.941270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb628f-66b8-4853-a71f-2a1df22d1732 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:53.941863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb628f-66b8-4853-a71f-2a1df22d1732 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:53.941863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb628f-66b8-4853-a71f-2a1df22d1732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:53.969256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c9eb628f-66b8-4853-a71f-2a1df22d1732 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:53.970779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c9eb628f-66b8-4853-a71f-2a1df22d1732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:54.055861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 238/482] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:54.483472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7a77-026d-47b2-9692-361e18eec8b1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:54.506239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebae98-d5b4-43af-b529-dda289c04658 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:54.506985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebae98-d5b4-43af-b529-dda289c04658 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:54.507562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebae98-d5b4-43af-b529-dda289c04658 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:54.508771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:54.511958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 239/483] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:54.518532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0893c1-3b76-419b-8283-d3f30a62f260 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:54.519477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0893c1-3b76-419b-8283-d3f30a62f260 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:54.520000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0893c1-3b76-419b-8283-d3f30a62f260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:54.550433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fc0893c1-3b76-419b-8283-d3f30a62f260 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:54.553600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fc0893c1-3b76-419b-8283-d3f30a62f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:54.614935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:54.661908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c7a77-026d-47b2-9692-361e18eec8b1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:54.701114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 240/484] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:06:54.723490 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf08934-b150-4a1b-a465-e2da14ce9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:54.724133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08934-b150-4a1b-a465-e2da14ce9648 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:54.724446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08934-b150-4a1b-a465-e2da14ce9648 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:54.724725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf08934-b150-4a1b-a465-e2da14ce9648 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:54.744134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf08934-b150-4a1b-a465-e2da14ce9648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5bf08934-b150-4a1b-a465-e2da14ce9648 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:54.748941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:54.749832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:54.750642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 245/485] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:06:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:54.756057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0893c1-3b76-419b-8283-d3f30a62f260 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:54.874263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0893c1-3b76-419b-8283-d3f30a62f260 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:54.916974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2835994-61cb-4f0c-af5c-663938fba859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:54.917598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835994-61cb-4f0c-af5c-663938fba859 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:54.917927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835994-61cb-4f0c-af5c-663938fba859 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:54.918205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835994-61cb-4f0c-af5c-663938fba859 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:54.918884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835994-61cb-4f0c-af5c-663938fba859 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:54.919184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835994-61cb-4f0c-af5c-663938fba859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:54.920667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835994-61cb-4f0c-af5c-663938fba859 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:54.929793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 241/486] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:06:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:54.935205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf08934-b150-4a1b-a465-e2da14ce9648 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:54.971313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d912da-14e6-4366-a2ac-9b549754603a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:54.971843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d912da-14e6-4366-a2ac-9b549754603a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:54.971843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d912da-14e6-4366-a2ac-9b549754603a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:54.973679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 242/487] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:06:54.979345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74393355-423a-4abe-8363-9be45dd8f9d1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:54.979623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74393355-423a-4abe-8363-9be45dd8f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:54.979984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74393355-423a-4abe-8363-9be45dd8f9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.011982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-74393355-423a-4abe-8363-9be45dd8f9d1 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:55.016689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-74393355-423a-4abe-8363-9be45dd8f9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:55.042945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:55.057437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:55.082170 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf08934-b150-4a1b-a465-e2da14ce9648 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.106525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 243/488] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 10:06:55.107578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74393355-423a-4abe-8363-9be45dd8f9d1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:55.124656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:55.132423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.132423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.132423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.137568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:55.139086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:55.155848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:55.156814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:55.157667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:55.157667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:55.157667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:55.157667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 246/489] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:55.164022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:55.271903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5bee6-40b5-4122-ac65-17cc008ac299 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.300874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:55.309909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:55.310519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.313727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.313727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.313727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:55.313727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:55.313727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:55.326696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 247/490] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:06:55.331932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:55.405937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74393355-423a-4abe-8363-9be45dd8f9d1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.444308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3693ac-e48c-49ec-a478-a1ac9d532929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:55.444957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3693ac-e48c-49ec-a478-a1ac9d532929 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.445237 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3693ac-e48c-49ec-a478-a1ac9d532929 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.445565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3693ac-e48c-49ec-a478-a1ac9d532929 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.456081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3693ac-e48c-49ec-a478-a1ac9d532929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2e3693ac-e48c-49ec-a478-a1ac9d532929 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:55.461169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:55.462626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:55.463719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 244/491] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:06:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:55.464989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3693ac-e48c-49ec-a478-a1ac9d532929 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:55.469671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4bfe2-530f-4845-a75e-f4a9ea69a8d7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.482270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:55.511400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa2fc4-ddf0-4716-9617-6219b33c459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:55.512031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa2fc4-ddf0-4716-9617-6219b33c459d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.512342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa2fc4-ddf0-4716-9617-6219b33c459d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.512624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa2fc4-ddf0-4716-9617-6219b33c459d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.520097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa2fc4-ddf0-4716-9617-6219b33c459d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:55.521841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa2fc4-ddf0-4716-9617-6219b33c459d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-20fa2fc4-ddf0-4716-9617-6219b33c459d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:06:55.535419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:55.536372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:55.537362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 248/492] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:06:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:55.537942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bbef-43c9-4104-8e21-c3516a50fd88 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.537942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bbef-43c9-4104-8e21-c3516a50fd88 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.539275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979bbef-43c9-4104-8e21-c3516a50fd88 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.539848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 249/493] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:55.544875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979bbef-43c9-4104-8e21-c3516a50fd88 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:55.581651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3693ac-e48c-49ec-a478-a1ac9d532929 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.596324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:55.615954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aa549-d399-422d-a2df-d6de318017e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:55.616615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa549-d399-422d-a2df-d6de318017e8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.616892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa549-d399-422d-a2df-d6de318017e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.617164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa549-d399-422d-a2df-d6de318017e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.628658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aa549-d399-422d-a2df-d6de318017e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-778aa549-d399-422d-a2df-d6de318017e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:55.633450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:55.635198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 245/494] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:06:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:55.636047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aa549-d399-422d-a2df-d6de318017e8 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:55.659108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979bbef-43c9-4104-8e21-c3516a50fd88 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.695242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850718a3-f104-422d-8877-149ee90841a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:55.695881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850718a3-f104-422d-8877-149ee90841a0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.696122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850718a3-f104-422d-8877-149ee90841a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.696450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850718a3-f104-422d-8877-149ee90841a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.697210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850718a3-f104-422d-8877-149ee90841a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:55.697429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850718a3-f104-422d-8877-149ee90841a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:55.698798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850718a3-f104-422d-8877-149ee90841a0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:55.707031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 250/495] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:06:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:55.713060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952c66-02de-47da-92ba-30df2e9299eb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.713424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952c66-02de-47da-92ba-30df2e9299eb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.713799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952c66-02de-47da-92ba-30df2e9299eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.719074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:55.731924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e7952c66-02de-47da-92ba-30df2e9299eb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:55.733161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e7952c66-02de-47da-92ba-30df2e9299eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:55.745461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aa549-d399-422d-a2df-d6de318017e8 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.780310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:55.780942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.781337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.781621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.782365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:55.782673 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:55.784138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:55.811254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 251/496] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:55.812378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7952c66-02de-47da-92ba-30df2e9299eb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:55.830157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 246/497] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:06:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:55.830157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:55.884818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:55.952227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7952c66-02de-47da-92ba-30df2e9299eb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.966135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f32a6-e428-4831-bbd8-8cae4ddc50c3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:55.994945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:55.995559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:55.996025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:55.996128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:55.996795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:55.997098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:55.998462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:55.999400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.004691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff595fe-3bb2-49b0-a60f-ffbe1e523153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.005449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff595fe-3bb2-49b0-a60f-ffbe1e523153 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.005706 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff595fe-3bb2-49b0-a60f-ffbe1e523153 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.005980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff595fe-3bb2-49b0-a60f-ffbe1e523153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.007411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 252/498] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:06:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:56.008213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.020859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff595fe-3bb2-49b0-a60f-ffbe1e523153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.022346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff595fe-3bb2-49b0-a60f-ffbe1e523153 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-9ff595fe-3bb2-49b0-a60f-ffbe1e523153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:56.037736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:56.038926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:56.039773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:56.039773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:56.039773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:56.039773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 247/499] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:56.041101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bfea-26b1-4472-a703-b88a4dd54976 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.041101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bfea-26b1-4472-a703-b88a4dd54976 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.041340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bfea-26b1-4472-a703-b88a4dd54976 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.042738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 248/500] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:06:56.043297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2bfea-26b1-4472-a703-b88a4dd54976 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.125681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa169a0-4903-41d0-9848-c3f7c8ccc8f4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.127189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.151178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2bfea-26b1-4472-a703-b88a4dd54976 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.159112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9215356-6401-4a88-8d13-e4aeca2aa37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.159713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9215356-6401-4a88-8d13-e4aeca2aa37a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.160002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9215356-6401-4a88-8d13-e4aeca2aa37a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.160274 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9215356-6401-4a88-8d13-e4aeca2aa37a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.185356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.185980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.186261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.186536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.196448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.197959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:56.211876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:56.213260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:56.214143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:56.214143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:56.214143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:56.214143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 249/501] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:56.214365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.231831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9215356-6401-4a88-8d13-e4aeca2aa37a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.233311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9215356-6401-4a88-8d13-e4aeca2aa37a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.248202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.312180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab71f72-8a52-4f7c-b2be-ac018f9642c6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.329649 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 253/502] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:56.330951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0150-5275-4ccb-a8fa-3f8a9173520a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.331245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0150-5275-4ccb-a8fa-3f8a9173520a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.331513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0150-5275-4ccb-a8fa-3f8a9173520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.338153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.346218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.348959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.348959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.348959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.348959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:56.348959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.349510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-eaef0150-5275-4ccb-a8fa-3f8a9173520a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:06:56.349704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.350552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eaef0150-5275-4ccb-a8fa-3f8a9173520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:06:56.361308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 250/503] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:56.362100 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.421572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 254/504] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:06:56.422302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef0150-5275-4ccb-a8fa-3f8a9173520a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.460816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.467237 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4cf49-be10-40d1-bb07-2bd19f73deaf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.506506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459f506-7f45-46f1-9aab-69ff7bb07e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.507164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f506-7f45-46f1-9aab-69ff7bb07e57 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.507452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f506-7f45-46f1-9aab-69ff7bb07e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.507730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f506-7f45-46f1-9aab-69ff7bb07e57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.518619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459f506-7f45-46f1-9aab-69ff7bb07e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0459f506-7f45-46f1-9aab-69ff7bb07e57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:06:56.523467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:56.524579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:56.525511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 251/505] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:56.526332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459f506-7f45-46f1-9aab-69ff7bb07e57 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.530832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef0150-5275-4ccb-a8fa-3f8a9173520a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.562445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.567429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.568279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.568606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.568880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.569531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:56.569835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.571206 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.583043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 255/506] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:56.583672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.643089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459f506-7f45-46f1-9aab-69ff7bb07e57 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.679020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.679573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.679855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.680117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.691218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.692201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2831-f187-41a7-99f7-488ca754361c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.692707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:56.708502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:56.709458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:56.710301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:56.710301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:56.710301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:56.710301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 252/507] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:56.710647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.721764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.730723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.732152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.732152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.732152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.739563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.741220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:06:56.753040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:56.754123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 10:06:56.755157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:56.756994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 256/508] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:56.757773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.812760 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c30be8-ac85-4e89-a5aa-906aae0e80ee None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.815979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.857593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.858205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.858484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.858753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.859445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:56.859816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.861211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.866015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64f7e4-1de0-4c8c-8f7c-bf141037f5a3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:56.869291 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 253/509] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:56.870115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.903787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:56.904444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:56.904724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:56.905003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:56.912205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:56.913927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:06:56.925201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:56.926229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:56.927152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 257/510] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:56.927717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:56.946161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:56.977796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f4864-c750-4654-902f-7aae31075c98 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.011284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.011912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.012176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.012488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.022948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.024442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.036272 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc2b8-3316-4245-832a-a9f3fa111a23 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:57.038347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:57.039663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:57.040848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:57.040848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:57.040848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:57.040848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 254/511] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:57.040848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.052459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:57.074403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.075003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.075281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.075562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.076199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:57.076527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.077896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.092530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 258/512] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:57.092530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.140113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f628c9-4bf9-4dfb-ae1e-c3d27df0364d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.186082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400968e-9d7c-4224-b53d-a405e3f79f03 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.193805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:57.206101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.206636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.206922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.207198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.207926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:57.208229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.209740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.220857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.221539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.221820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.222088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.230986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 255/513] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:57.231798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.232204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.233610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:57.250604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:57.251586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:57.252718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:57.252718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:57.252718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:57.252718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 259/514] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:57.252939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.279755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:57.336782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885d377-456c-4c19-87ce-45842ef9a76b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.353980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77d8b-d514-41fd-bb33-5cf52c29dbd9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.371557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0651121-a266-4e37-a816-b58a689583af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.372160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0651121-a266-4e37-a816-b58a689583af None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.372473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0651121-a266-4e37-a816-b58a689583af None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.372744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0651121-a266-4e37-a816-b58a689583af None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.373473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0651121-a266-4e37-a816-b58a689583af None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:57.373774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0651121-a266-4e37-a816-b58a689583af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.375224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0651121-a266-4e37-a816-b58a689583af None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.389660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.390263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.390540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.390811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.391448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:57.391749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.392803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 256/515] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:57.393146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.393615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0651121-a266-4e37-a816-b58a689583af None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.408336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 260/516] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:57.408336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.437461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:57.489983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:57.499069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0651121-a266-4e37-a816-b58a689583af None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.505250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744874db-40ae-402a-9dbb-bf260ea6cdbf None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.533871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.534495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.534773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.535045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.541328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8178e-dc9d-4a69-8f24-8c85b4349d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.541838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.541933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8178e-dc9d-4a69-8f24-8c85b4349d6f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.542197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8178e-dc9d-4a69-8f24-8c85b4349d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.542473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8178e-dc9d-4a69-8f24-8c85b4349d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.543298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:06:57.555202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:57.556467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 257/517] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:57.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.617423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8178e-dc9d-4a69-8f24-8c85b4349d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.618891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8178e-dc9d-4a69-8f24-8c85b4349d6f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.653682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:57.657158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab692-58bf-4468-a2f6-b7f0a4fb3f61 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.692480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.693088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.693372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.693645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.694292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:57.694594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.695984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.707728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 258/518] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:57.708550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.711616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:57.728934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 261/519] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:57.729808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8178e-dc9d-4a69-8f24-8c85b4349d6f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:57.808953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec003fa-6dfd-4981-ae0e-439cabba9fcb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.828273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8178e-dc9d-4a69-8f24-8c85b4349d6f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:57.843508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e759e-57a5-4293-b744-1940deb7c304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.844121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e759e-57a5-4293-b744-1940deb7c304 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.844431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e759e-57a5-4293-b744-1940deb7c304 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.844709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e759e-57a5-4293-b744-1940deb7c304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.862536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643874-527d-4115-83e7-ef869d40d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:57.863147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643874-527d-4115-83e7-ef869d40d0b7 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:57.863421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643874-527d-4115-83e7-ef869d40d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:57.863693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643874-527d-4115-83e7-ef869d40d0b7 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:57.864370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43643874-527d-4115-83e7-ef869d40d0b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.865800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43643874-527d-4115-83e7-ef869d40d0b7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.871639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:57.911445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e759e-57a5-4293-b744-1940deb7c304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:57.912919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e759e-57a5-4293-b744-1940deb7c304 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:57.934855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 262/520] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:06:57 2022] POST /identity/v3/users => generated 247 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:06:57.935842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643874-527d-4115-83e7-ef869d40d0b7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.002659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:58.021370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 259/521] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:58.022300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e759e-57a5-4293-b744-1940deb7c304 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.075782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643874-527d-4115-83e7-ef869d40d0b7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.094251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:58.116204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.116887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.117168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.117439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.118195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:58.119014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.120525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.142505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 263/522] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:06:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:58.143358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.144991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e759e-57a5-4293-b744-1940deb7c304 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.183609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.184266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.184603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.184879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.192528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.193996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:06:58.206526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:58.207476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 260/523] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:58.208437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.255620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:58.258547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a03a0-6279-49b2-9265-b2ca24e18b25 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.293404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.294034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.294323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.294604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.304936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.306974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.316556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766d0e3-472f-44cc-b42c-7d14d53d996b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:58.322579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:58.323589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:58.324458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:58.324458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:58.324458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:58.328442 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 264/524] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:58.329064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.335723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:58.353514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.354132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.354405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.354701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.366128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.367858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:58.383132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:58.384657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:58.385585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:58.385585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:58.385585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:58.385585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 261/525] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:58.385803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.444921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e175-c819-4077-be3c-6858c0f7a6b5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.483207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.483836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.484093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.484396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.485128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=7e8ce142e0c944b49053bd2a44ce4853) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:58.485437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.486888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.492551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 265/526] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/role_assignments?user.id=7e8ce142e0c944b49053bd2a44ce4853&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:58.493941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.521405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486bf3f0-a1fc-47e4-ade6-4e23521c559c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.524021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:58.570468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.571101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.572006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.572288 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.573250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:58.573923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.575712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.600619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 262/527] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:58.602011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.615934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb58cb-72be-474b-a0b3-4bb2686c7b44 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.642798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:58.660712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.661585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.662337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.662337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.662987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:58.663310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.665692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.679078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 266/528] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:58.680037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.754228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670d92b-e4a0-4026-8eef-312898333c1a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.768270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:58.795122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.796096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.796687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.797165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.798035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:58.798541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.799443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21451bba-a5d9-44cc-ae10-ff0e59909494 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:58.800410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.816727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 263/529] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:58.818844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:58.845750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d250e6-fccf-4af0-817d-90b846b9bf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:58.846368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d250e6-fccf-4af0-817d-90b846b9bf40 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:58.846656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d250e6-fccf-4af0-817d-90b846b9bf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:58.846935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d250e6-fccf-4af0-817d-90b846b9bf40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:58.927873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d250e6-fccf-4af0-817d-90b846b9bf40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:58.929857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d250e6-fccf-4af0-817d-90b846b9bf40 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:58.937498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:58.955195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57a1f8-9a18-4ab9-820e-bd1a174d8fc3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:59.003222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:59.003867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:59.004149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:59.004454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:59.014464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:59.016536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:59.016742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:06:59.032825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:59.034185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:59.035042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:06:59.035042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:06:59.035042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:06:59.035042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:06:59.035042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:06:59.035042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:06:59.035042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:06:59.035042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:59.039420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 264/530] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:59.040672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:59.050498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 267/531] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:06:59.051684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d250e6-fccf-4af0-817d-90b846b9bf40 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:59.162515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d250e6-fccf-4af0-817d-90b846b9bf40 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:59.182011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f79b90-69b6-45d4-a050-c89f1bde0667 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:59.198806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:59.199405 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:59.199758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:59.200102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:59.200912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:59.201291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:59.202834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:59.219396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 268/532] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:06:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:59.219396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:59.227306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:59.228087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:59.228398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:59.228678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:59.237215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:59.238820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:06:59.253753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:59.254601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:59.255481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:06:59.255481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:06:59.255481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:06:59.255481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:06:59.255481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:06:59.255481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:06:59.255481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:06:59.255481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:06:59.260373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 265/533] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:59.262024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:59.270184 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:59.276800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:59.355183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762157-3eba-4990-ad51-44d1de845ec7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:59.390759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e67f03-2333-491b-b6bc-0315803cdae5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:59.400943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:59.402346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:59.402808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:59.403649 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:59.416855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:59.419076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:59.435094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:59.435715 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:59.436068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:59.436447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:59.437425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=4b03cdf17a244cf094a7ce93775da22c) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:59.437804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:59.439349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:06:59.440948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:06:59.441886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:06:59.442824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:06:59.442824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:06:59.442824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:06:59.445045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 269/534] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:06:59.446108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:59.453018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 266/535] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:59 2022] GET /identity/v3/role_assignments?user.id=4b03cdf17a244cf094a7ce93775da22c&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:59.453018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:59.627055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:59.633556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:06:59.657657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9933246-c402-4077-b1c7-cf25b35c092d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:59.674166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f6249-422d-46eb-bc60-49b0863e513b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:59.718080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:59.718616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:59.718904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:59.719434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:59.720833 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:59.721149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:59.722594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:59.741451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:06:59.742067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:06:59.742346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:06:59.742620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:06:59.743889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:06:59.744200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:06:59.745690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:06:59.751338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 270/536] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:06:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:59.757064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:59.778632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 267/537] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:06:59.781569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:06:59.963849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d6ef3-1fb1-4129-a31e-a08a3bfa0732 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:06:59.982595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bafae-18d9-4151-9a09-da5f9b92ac2b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:00.005463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e6b4d-2b26-4ba5-bb5b-cfddc857000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:00.006398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6b4d-2b26-4ba5-bb5b-cfddc857000e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.006878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6b4d-2b26-4ba5-bb5b-cfddc857000e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.007469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6b4d-2b26-4ba5-bb5b-cfddc857000e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.008289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6b4d-2b26-4ba5-bb5b-cfddc857000e None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=00283447a1a6405b952e541a13c91110) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:00.008757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6b4d-2b26-4ba5-bb5b-cfddc857000e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:00.010751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6b4d-2b26-4ba5-bb5b-cfddc857000e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:00.017498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 271/538] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:06:59 2022] GET /identity/v3/role_assignments?user.id=00283447a1a6405b952e541a13c91110&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:00.019052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:00.019968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223c724-7161-4971-9721-80f8012f6c0f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.028325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223c724-7161-4971-9721-80f8012f6c0f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.028325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223c724-7161-4971-9721-80f8012f6c0f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.028325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 272/539] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:00.029566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20ba2-c986-4188-9716-c08364db529d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.029895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20ba2-c986-4188-9716-c08364db529d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.030134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a20ba2-c986-4188-9716-c08364db529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.038463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:00.041727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.042262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.042740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.058735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:00.063683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:00.065481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-28a20ba2-c986-4188-9716-c08364db529d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:00.067121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-28a20ba2-c986-4188-9716-c08364db529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:00.087849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:00.093875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:00.099799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:00.100695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 268/540] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:06:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:00.103700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:00.219487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 273/541] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:07:00.257354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e701f-7938-417f-a058-408b0733d204 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:00.304666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:00.305287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.306091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.306368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.307076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:00.307368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:00.308885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:00.331569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 269/542] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:00.337748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20ba2-c986-4188-9716-c08364db529d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:00.465920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a20ba2-c986-4188-9716-c08364db529d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:00.517652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb193abb-3cc3-4379-a261-d4f7b3037c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:00.518195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193abb-3cc3-4379-a261-d4f7b3037c3f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.518482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193abb-3cc3-4379-a261-d4f7b3037c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.518764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb193abb-3cc3-4379-a261-d4f7b3037c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.519517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb193abb-3cc3-4379-a261-d4f7b3037c3f None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=757ad5baa909451d94dd1eced0407d50) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:00.519832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb193abb-3cc3-4379-a261-d4f7b3037c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:00.521316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb193abb-3cc3-4379-a261-d4f7b3037c3f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:00.524605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:00.529306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 274/543] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:00 2022] GET /identity/v3/role_assignments?user.id=757ad5baa909451d94dd1eced0407d50&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:00.583297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:00.634837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851991e-e719-4c9d-a122-1ecada41225d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:00.678217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b6bd7-b866-4867-b238-add56af52326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:00.678960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b6bd7-b866-4867-b238-add56af52326 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.679245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b6bd7-b866-4867-b238-add56af52326 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.679516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b6bd7-b866-4867-b238-add56af52326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.695993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496477-a198-49c9-8fb1-ae2accb0a43f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.696816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b6bd7-b866-4867-b238-add56af52326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:00.696951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496477-a198-49c9-8fb1-ae2accb0a43f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.697421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496477-a198-49c9-8fb1-ae2accb0a43f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.699309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 275/544] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c59b6bd7-b866-4867-b238-add56af52326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:00.702196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:00.703121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:00.703925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 270/545] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:00.709209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56b5f-6197-4b15-bec2-a863054cbdec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.709457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b6bd7-b866-4867-b238-add56af52326 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:00.710061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56b5f-6197-4b15-bec2-a863054cbdec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.710541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56b5f-6197-4b15-bec2-a863054cbdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.727536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:00.735863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d5a56b5f-6197-4b15-bec2-a863054cbdec None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:00.737787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d5a56b5f-6197-4b15-bec2-a863054cbdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:00.844720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 276/546] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:00.878666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b6bd7-b866-4867-b238-add56af52326 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:00.896666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:00.915475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:00.916249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:00.916560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:00.916831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:00.917525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:00.917833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:00.919236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:00.928271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 271/547] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:00.934111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a56b5f-6197-4b15-bec2-a863054cbdec None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:01.043762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a56b5f-6197-4b15-bec2-a863054cbdec None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:01.082472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:01.082472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:01.082472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:01.082472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:01.085155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:01.097578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:01.097578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:01.111613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:01.113003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:01.113870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:01.113870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:01.113870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:01.113870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 277/548] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:01.119994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:01.230806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d2e1c-719d-40d5-bc09-ed974bda77b3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:01.271440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:01.272067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:01.272371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:01.272650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:01.273313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:01.273615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:01.275845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:01.293327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 272/549] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:01.299032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:01.311769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:01.405952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:01.421704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbcb8d-9d17-43b9-a740-6ad9e1b0021d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:01.447527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3eba0-6163-43f2-a4f8-fb8905e9df66 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:01.468466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:01.469042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:01.469812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:01.470102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:01.481569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:01.483489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:01.483692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8904a96-943f-4344-b0c4-eed2e6fd700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:01.484351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8904a96-943f-4344-b0c4-eed2e6fd700e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:01.484643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8904a96-943f-4344-b0c4-eed2e6fd700e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:01.484923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8904a96-943f-4344-b0c4-eed2e6fd700e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:01.496914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:01.497902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:01.498835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 278/550] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:01.504641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:01.518252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8904a96-943f-4344-b0c4-eed2e6fd700e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a8904a96-943f-4344-b0c4-eed2e6fd700e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:01.523349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:01.524496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:01.525835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:01.532881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 273/551] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:01.541643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8904a96-943f-4344-b0c4-eed2e6fd700e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:01.562773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:01.626463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70a5e9-3acd-458f-acfe-4601f19eb264 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:01.666545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:01.667084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:01.667538 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:01.667819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:01.668600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:01.668909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:01.670925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:01.717341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 279/552] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 10:07:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:01.723193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:01.762258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:01.770193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8904a96-943f-4344-b0c4-eed2e6fd700e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:01.812838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80ed5d-6ac3-40d0-ac7d-0b2e117cda13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:01.813454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ed5d-6ac3-40d0-ac7d-0b2e117cda13 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:01.813737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ed5d-6ac3-40d0-ac7d-0b2e117cda13 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:01.814016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ed5d-6ac3-40d0-ac7d-0b2e117cda13 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:01.814688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80ed5d-6ac3-40d0-ac7d-0b2e117cda13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:01.814992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80ed5d-6ac3-40d0-ac7d-0b2e117cda13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:01.816595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80ed5d-6ac3-40d0-ac7d-0b2e117cda13 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:01.827674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 274/553] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:01.829380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27d32-0399-4ac5-92d2-a8030e505a32 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:01.829670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27d32-0399-4ac5-92d2-a8030e505a32 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:01.830080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27d32-0399-4ac5-92d2-a8030e505a32 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:01.835600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 275/554] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:01.835600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27d32-0399-4ac5-92d2-a8030e505a32 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:01.863685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894849c6-b63b-4179-80ea-3fe630975d58 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:01.874171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:01.908081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df006d-03c8-4879-8224-e3f3c4ec6e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:01.909094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df006d-03c8-4879-8224-e3f3c4ec6e87 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:01.909396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df006d-03c8-4879-8224-e3f3c4ec6e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:01.909677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df006d-03c8-4879-8224-e3f3c4ec6e87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:01.976672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27d32-0399-4ac5-92d2-a8030e505a32 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:01.997720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df006d-03c8-4879-8224-e3f3c4ec6e87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:01.999449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df006d-03c8-4879-8224-e3f3c4ec6e87 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:02.022432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6c91c-83cb-4088-a8b9-24a771a10912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:02.023437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c91c-83cb-4088-a8b9-24a771a10912 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.023912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c91c-83cb-4088-a8b9-24a771a10912 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.025361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6c91c-83cb-4088-a8b9-24a771a10912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.037152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c91c-83cb-4088-a8b9-24a771a10912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:02.039240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6c91c-83cb-4088-a8b9-24a771a10912 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1cf6c91c-83cb-4088-a8b9-24a771a10912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:02.060521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:02.062467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:02.064265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:02.064265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:02.064265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:02.067692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 276/555] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:02.070278 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0c6c-1116-4257-a266-170b14fd274b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.071075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0c6c-1116-4257-a266-170b14fd274b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.072124 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e0c6c-1116-4257-a266-170b14fd274b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.093433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bf2e0c6c-1116-4257-a266-170b14fd274b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:02.094967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf2e0c6c-1116-4257-a266-170b14fd274b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:02.097307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:02.120402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 280/556] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 10:07:02.121636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df006d-03c8-4879-8224-e3f3c4ec6e87 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:02.173163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 277/557] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:02.174848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0c6c-1116-4257-a266-170b14fd274b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:02.188230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:02.352054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df006d-03c8-4879-8224-e3f3c4ec6e87 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:02.356927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e0c6c-1116-4257-a266-170b14fd274b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:02.389727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:02.390672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.391185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.391661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.392545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:02.393053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:02.394641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:02.407788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 281/558] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:02.417324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:02.430168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:02.431051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.431416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.431700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.443197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:02.449902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:02.452556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:02.482042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:02.483084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:02.483981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:02.483981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:02.483981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:02.489029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 278/559] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:02.489866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:02.519267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:02.559097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a987e-d6a1-418f-8379-9df3189ea816 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:02.595614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:02.596319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.596613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.596890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.606312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:02.607805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:02.616368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5923-c68a-493a-a0bd-42325a7f86ae None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:02.620098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:02.621143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:02.622094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 282/560] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:02.622699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:02.657894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0c797-b5dd-438c-8a1e-e3d54519bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:02.658525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0c797-b5dd-438c-8a1e-e3d54519bf0d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.658804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0c797-b5dd-438c-8a1e-e3d54519bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.659077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0c797-b5dd-438c-8a1e-e3d54519bf0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.670908 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0c797-b5dd-438c-8a1e-e3d54519bf0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4fa0c797-b5dd-438c-8a1e-e3d54519bf0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:02.676155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:02.677244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:02.678194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 279/561] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:02.678903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ab63-b484-40cb-934f-968bff47d151 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.679421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ab63-b484-40cb-934f-968bff47d151 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.679528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720ab63-b484-40cb-934f-968bff47d151 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.684335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 280/562] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:02.684335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ab63-b484-40cb-934f-968bff47d151 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:02.735999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:02.742401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fb065-a21e-43bd-b27b-1f291671388f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:02.776831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:02.788113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:02.789010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.789275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.789538 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.790283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720ab63-b484-40cb-934f-968bff47d151 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:02.790488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:02.790734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:02.792243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:02.811520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 283/563] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:02.811520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:02.834692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc08f8-9846-469a-9380-1ff5c6f71f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:02.835307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc08f8-9846-469a-9380-1ff5c6f71f7d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.835583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc08f8-9846-469a-9380-1ff5c6f71f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.835853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc08f8-9846-469a-9380-1ff5c6f71f7d None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.837364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc08f8-9846-469a-9380-1ff5c6f71f7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:02.837640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc08f8-9846-469a-9380-1ff5c6f71f7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:02.839100 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc08f8-9846-469a-9380-1ff5c6f71f7d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:02.861241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 281/564] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:02.862740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c54e-e1a6-4105-bac3-c483f8685e5b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.863029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c54e-e1a6-4105-bac3-c483f8685e5b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.863305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c54e-e1a6-4105-bac3-c483f8685e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.893552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1b62c54e-e1a6-4105-bac3-c483f8685e5b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:02.894738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1b62c54e-e1a6-4105-bac3-c483f8685e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:02.926299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4366ff2-7255-4b1b-a57a-0256e8193380 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:02.962156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:02.962758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:02.963052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:02.963309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:02.963969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:02.964268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:02.965654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:02.967167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 282/565] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:02.968346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62c54e-e1a6-4105-bac3-c483f8685e5b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:02.983474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 284/566] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:02.984578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.023918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:03.047658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:03.099030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62c54e-e1a6-4105-bac3-c483f8685e5b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.106665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d055adb-e444-4dd6-8c47-25019835b6f8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.135195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.136059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.136377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.136659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.143497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.144251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67192e55-05cb-413a-add4-8913faabfa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.145005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.145315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192e55-05cb-413a-add4-8913faabfa10 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.145776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192e55-05cb-413a-add4-8913faabfa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.146221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67192e55-05cb-413a-add4-8913faabfa10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:03.156587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:03.157497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:03.158398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 283/567] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:03.158902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.161111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67192e55-05cb-413a-add4-8913faabfa10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.162928 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67192e55-05cb-413a-add4-8913faabfa10 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-67192e55-05cb-413a-add4-8913faabfa10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:03.179570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:03.180844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:03.181832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:03.181832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:03.181832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:03.181832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 285/568] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:03.182533 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125efc8-80e8-430c-a5c7-0b3f5f3f763e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.182806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125efc8-80e8-430c-a5c7-0b3f5f3f763e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.183076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125efc8-80e8-430c-a5c7-0b3f5f3f763e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.188408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 286/569] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:03.188408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125efc8-80e8-430c-a5c7-0b3f5f3f763e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.267016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:03.270859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b20fbf-9157-4774-9c1e-37e86536707c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.294590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:03.298372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125efc8-80e8-430c-a5c7-0b3f5f3f763e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.305732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.306458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.306741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.307018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.317193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.318640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.332269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c957074-58b1-44c4-be15-9e49e301605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.332897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957074-58b1-44c4-be15-9e49e301605e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.333179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957074-58b1-44c4-be15-9e49e301605e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.333455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c957074-58b1-44c4-be15-9e49e301605e None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:03.333548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:03.334614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:03.335530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:03.335530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:03.335530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:03.335704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c957074-58b1-44c4-be15-9e49e301605e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:03.335704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c957074-58b1-44c4-be15-9e49e301605e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.335842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 284/570] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:03.335842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.336029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c957074-58b1-44c4-be15-9e49e301605e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.348326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 287/571] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:03.349534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4cfe-ece5-4e0d-beb8-31f59dda6c38 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.349827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4cfe-ece5-4e0d-beb8-31f59dda6c38 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.350138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4cfe-ece5-4e0d-beb8-31f59dda6c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.367549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a7ae4cfe-ece5-4e0d-beb8-31f59dda6c38 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:03.368787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a7ae4cfe-ece5-4e0d-beb8-31f59dda6c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:03.435225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 288/572] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:03.436263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4cfe-ece5-4e0d-beb8-31f59dda6c38 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.453438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b61931-ab33-4e71-9486-03c057ab18de None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.488949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.489785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.490069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.490351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.490999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:03.491306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.492758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.509457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 285/573] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:03.509457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.521759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:03.540712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:03.550622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4cfe-ece5-4e0d-beb8-31f59dda6c38 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.586026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e928e-acf5-43e2-b3be-7d4746660101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.586743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e928e-acf5-43e2-b3be-7d4746660101 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.587569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e928e-acf5-43e2-b3be-7d4746660101 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.587788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e928e-acf5-43e2-b3be-7d4746660101 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.599027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e928e-acf5-43e2-b3be-7d4746660101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-fd2e928e-acf5-43e2-b3be-7d4746660101 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:03.604748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:03.605686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 289/574] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:03.606953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e928e-acf5-43e2-b3be-7d4746660101 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.621202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202abf-4db6-4e9e-bd3a-6b9172bff7dc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.656878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.657593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.657932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.658307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.658948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:03.659252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.660903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.677593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 286/575] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:03.678684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.712605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e928e-acf5-43e2-b3be-7d4746660101 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.746271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.746873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.747155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.747431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.748191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=00dd24daa5374b85adbca9b16b807537) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:03.748529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.749962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.751788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:03.755305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 290/576] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/role_assignments?user.id=00dd24daa5374b85adbca9b16b807537&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:03.756110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.774922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:03.787759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c4af4-06e4-461a-a039-b29d11a7c2fa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.827338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.828010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.828340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.828640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.837502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.838911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:03.851074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:03.852090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:03.853639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 287/577] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:03.854307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.888440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0885a-df15-4c5d-b526-2dddfd630ceb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:03.928024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:03.928660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:03.928945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:03.929216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:03.929882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:03.930182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:03.932024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:03.940394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 291/578] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:03.941188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:03.969474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4946d14-9930-4cb0-8688-e503989f1a94 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.001090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:04.007376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.008013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.008452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.008749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.016610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.018346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.020396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:04.031170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:04.032339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 10:07:04.033509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:04.036977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 288/579] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:04.037821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.049004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a997cef-b764-4408-acb4-28b4808486b4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.086482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e515f3-b588-44cd-b281-20ba488e0612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.087757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e515f3-b588-44cd-b281-20ba488e0612 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.088044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e515f3-b588-44cd-b281-20ba488e0612 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.088492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e515f3-b588-44cd-b281-20ba488e0612 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.099306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e515f3-b588-44cd-b281-20ba488e0612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d6e515f3-b588-44cd-b281-20ba488e0612 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:04.105721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:04.106647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:04.107503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 292/580] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:04.108337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e515f3-b588-44cd-b281-20ba488e0612 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.148589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d0768-1282-4705-a1ec-50b98a27af84 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.201767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.202376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.202648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.202931 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.203626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:04.203930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.205396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.217322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 289/581] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:04.218126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.271040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:04.281258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e515f3-b588-44cd-b281-20ba488e0612 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.320110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.320762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.321319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.321605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.324607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:04.324788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d023fd-79ef-422b-ae2c-335ca9ce533b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.332683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.334154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:04.349168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:04.350161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:04.351078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:04.351078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:04.351078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:04.354266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 293/582] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:04.355135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.368957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.369757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.370040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.370313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.371057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:04.371423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.372951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.395472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 290/583] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:04.395472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.466856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66380c8e-c7dd-41ab-8e8b-a6e3522ae43e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.496792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01b25b-c32c-4290-a46e-477ca6d5a8b5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.502380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591139-2a4e-4022-8202-9005d615426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.503151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591139-2a4e-4022-8202-9005d615426d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.503578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591139-2a4e-4022-8202-9005d615426d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.504050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591139-2a4e-4022-8202-9005d615426d None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.504932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591139-2a4e-4022-8202-9005d615426d None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:04.505654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:04.506402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591139-2a4e-4022-8202-9005d615426d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.508058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591139-2a4e-4022-8202-9005d615426d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.517028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 294/584] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:04.517723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591139-2a4e-4022-8202-9005d615426d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.536468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbc58-908b-4af6-a380-d87fbebef247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.537142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbc58-908b-4af6-a380-d87fbebef247 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.537423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbc58-908b-4af6-a380-d87fbebef247 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.537746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbc58-908b-4af6-a380-d87fbebef247 None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/7e8ce142e0c944b49053bd2a44ce4853/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.554352 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbc58-908b-4af6-a380-d87fbebef247 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=7e8ce142e0c944b49053bd2a44ce4853, role_id=1beb7c9ed4094a7d9a1fc9e83a8c252c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.555877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbc58-908b-4af6-a380-d87fbebef247 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.569912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:04.615697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 291/585] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:04 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/7e8ce142e0c944b49053bd2a44ce4853/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:04.619839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591139-2a4e-4022-8202-9005d615426d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.625559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbc58-908b-4af6-a380-d87fbebef247 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.662097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.662782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.663067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.663401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.664437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:04.665484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.667006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.681688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 295/586] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:04.682442 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.778683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbc58-908b-4af6-a380-d87fbebef247 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.815019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1af10-bf55-4227-8957-5c165ad8bfd1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:04.828509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.829515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.830107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:04.830941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.831438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.844266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.846269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.856196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:04.856941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:04.857173 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:04.857452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:04.863754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:04.864748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:04.865642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:04.865642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:04.865642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:04.867738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 292/587] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:04.869717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:04.873610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:04.875119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:04.890939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:04.894436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:04.895378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:04.896415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:04.896415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:04.896415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:04.896415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 296/588] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:04.900567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.013335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c368a99-5b69-4941-8cb6-511d778a7972 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.023208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aa416-b17d-42e7-bab3-e14bc7a60099 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.051391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.052322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.052566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.052957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.062258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.062545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.063309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.063729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.064147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.064456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.065303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:05.065761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.067240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:05.076217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:05.077279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 10:07:05.078232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:05.082120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 293/589] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:05.083006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.084403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 297/590] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:05.085489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.112820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:05.203999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:05.241061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3d3a0-b34d-427a-8918-4b84fce937a2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.244849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f2ec8-1c4d-4d9a-a77c-4763e75517b9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.280845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.281549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.281827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.281996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.282796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:05.283103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.284504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.294300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.295251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.295738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.296213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.297266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:05.297775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.303248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 294/591] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:05.303248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.304210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.327696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 298/592] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:05.328900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.405731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d979f-830c-4f0c-be61-9f6e59d1ced2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.416388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:05.436113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c811a-dd91-4832-b065-428d3e04578f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.436799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:05.443136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.443771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.444049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.444337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.452590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.454060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:05.466907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:05.467825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:05.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:05.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:05.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:05.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:05.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:05.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:05.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:05.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:05.472857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 295/593] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:05.473414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.481730 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.483007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.483513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.483986 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.491851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.494161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:05.506546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:05.507541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 10:07:05.509112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:05.511304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 299/594] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:05.512427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.583953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1c33-3e4f-4635-9926-a12a9e515b98 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.619312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147a775-b764-44bc-a5cf-992d00f3c23f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.621026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.621847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.622128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.622406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.633798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.635829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:05.654881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:05.655909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:05.656860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:05.656860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:05.656860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:05.660363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 296/595] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:05.661937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.666521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.667144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.667447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.667707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.668513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:05.668898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.670382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.681498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:05.688330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 300/596] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:05.688330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.721906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:05.786670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271941a-cb5e-4072-a77d-6aac5e860831 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.797279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57d42-c151-45bc-a430-fea43bd8616c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.823958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.824919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.825376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.825820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.826728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:05.827204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.828849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.837719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161cb6e-ecda-4f2a-94b7-d309ea67aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:05.838499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161cb6e-ecda-4f2a-94b7-d309ea67aec3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.838785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161cb6e-ecda-4f2a-94b7-d309ea67aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.839898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161cb6e-ecda-4f2a-94b7-d309ea67aec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.840605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161cb6e-ecda-4f2a-94b7-d309ea67aec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:05.840918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161cb6e-ecda-4f2a-94b7-d309ea67aec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:05.842284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161cb6e-ecda-4f2a-94b7-d309ea67aec3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:05.847621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 297/597] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:05.848691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.859998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 301/598] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:05.861433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f39d-27a5-4824-9abd-b532ac9e1f70 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:05.861718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f39d-27a5-4824-9abd-b532ac9e1f70 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:05.861992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842f39d-27a5-4824-9abd-b532ac9e1f70 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:05.864355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 302/599] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:05.864355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f39d-27a5-4824-9abd-b532ac9e1f70 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:05.931797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:05.958106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:05.960884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aeed4-0fc8-46c7-bb9f-6523b07f67b7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.975027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842f39d-27a5-4824-9abd-b532ac9e1f70 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:05.999628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eced42-5d86-41ce-9f23-0751754fff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.000279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eced42-5d86-41ce-9f23-0751754fff61 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.000587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eced42-5d86-41ce-9f23-0751754fff61 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.000858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eced42-5d86-41ce-9f23-0751754fff61 None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/4b03cdf17a244cf094a7ce93775da22c/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.012706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.013345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.013630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.013910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.017280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eced42-5d86-41ce-9f23-0751754fff61 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=4b03cdf17a244cf094a7ce93775da22c, role_id=1beb7c9ed4094a7d9a1fc9e83a8c252c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:06.018973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eced42-5d86-41ce-9f23-0751754fff61 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:06.025710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:06.027159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:06.042319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:06.043314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:06.044190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:06.044190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:06.044190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:06.044190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 303/600] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:06.044190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:06.092404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 298/601] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:05 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/4b03cdf17a244cf094a7ce93775da22c/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:06.092404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0c2b-2b0f-497a-bba8-4a57373c5adf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.092404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0c2b-2b0f-497a-bba8-4a57373c5adf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.092404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0c2b-2b0f-497a-bba8-4a57373c5adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.107145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-070c0c2b-2b0f-497a-bba8-4a57373c5adf None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:06.108476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-070c0c2b-2b0f-497a-bba8-4a57373c5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:06.174070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8598-30aa-417a-a259-e9292988b96f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:06.190062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:06.209336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 299/602] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:06.210246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0c2b-2b0f-497a-bba8-4a57373c5adf None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:06.222164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.222892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.223176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.223452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.240850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:06.242335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:06.268510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:06.269470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:06.270358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:06.270358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:06.270358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:06.270358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:06.270358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:06.270358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:06.270358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:06.270358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:06.276339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 304/603] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:06.279112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:06.337707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:06.373805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0c2b-2b0f-497a-bba8-4a57373c5adf None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:06.443244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.443869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.444151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.444455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.445122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:06.445431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:06.446871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:06.451132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef77190-949e-491a-a772-5a299adea7ef None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:06.471468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 300/604] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:06.477640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:06.518007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.518660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.518901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.519177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.519883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:06.520192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:06.521663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:06.535835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 305/605] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:06.536700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:06.572111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:06.627040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854b30a-6a66-4ffe-badf-de8115d5e2ee None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:06.642693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1ae82-5277-410d-b991-533098d1a307 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:06.663964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.665543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.665896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.666167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.673139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:06.674609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:06.677256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:06.683569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda11922-372f-429a-b18d-26364bdfe6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.684217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11922-372f-429a-b18d-26364bdfe6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.684516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11922-372f-429a-b18d-26364bdfe6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.684807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11922-372f-429a-b18d-26364bdfe6d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:06.691638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:06.692619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 301/606] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:06.694858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:06.701066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda11922-372f-429a-b18d-26364bdfe6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-cda11922-372f-429a-b18d-26364bdfe6d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:06.706665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:06.707606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:06.708570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 306/607] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:06.709288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205a849-cdec-417d-a1da-b6c840e771c6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.710291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205a849-cdec-417d-a1da-b6c840e771c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.710291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205a849-cdec-417d-a1da-b6c840e771c6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.711244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 307/608] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:06.713960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205a849-cdec-417d-a1da-b6c840e771c6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:06.807165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0174d-21bb-47a0-8fff-bdc0c3b95a6b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:06.809929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:06.819736 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205a849-cdec-417d-a1da-b6c840e771c6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:06.850272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3b52c-8ffc-434d-b51b-75b3aace1308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.850985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b52c-8ffc-434d-b51b-75b3aace1308 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.851202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b52c-8ffc-434d-b51b-75b3aace1308 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.851485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3b52c-8ffc-434d-b51b-75b3aace1308 None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/00283447a1a6405b952e541a13c91110/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.858407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:06.859014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.859298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.859573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.860275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:06.860621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:06.862058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:06.867274 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3b52c-8ffc-434d-b51b-75b3aace1308 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=00283447a1a6405b952e541a13c91110, role_id=1beb7c9ed4094a7d9a1fc9e83a8c252c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:06.868909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3b52c-8ffc-434d-b51b-75b3aace1308 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:06.874776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 308/609] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:06.875593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:06.956684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 302/610] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:06 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/00283447a1a6405b952e541a13c91110/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:06.958120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad5562-d1f5-4083-b3b5-550e424e140b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:06.958434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad5562-d1f5-4083-b3b5-550e424e140b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:06.958725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad5562-d1f5-4083-b3b5-550e424e140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:06.981096 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a5360-576c-44a9-8ee0-ff95ec0048c5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:07.009652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9cad5562-d1f5-4083-b3b5-550e424e140b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:07.010907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9cad5562-d1f5-4083-b3b5-550e424e140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:07.016126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b21702-1239-4667-b706-7335725359f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:07.016788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21702-1239-4667-b706-7335725359f0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:07.017069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21702-1239-4667-b706-7335725359f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:07.017345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b21702-1239-4667-b706-7335725359f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:07.018043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b21702-1239-4667-b706-7335725359f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:07.018352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b21702-1239-4667-b706-7335725359f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:07.020035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b21702-1239-4667-b706-7335725359f0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:07.034387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 309/611] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:07.035288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b21702-1239-4667-b706-7335725359f0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:07.054701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:07.081273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:07.111860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 303/612] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:07.113037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad5562-d1f5-4083-b3b5-550e424e140b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:07.167118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b21702-1239-4667-b706-7335725359f0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:07.215130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b8ec-8356-4cb7-ba24-2574f96e0cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:07.215706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b8ec-8356-4cb7-ba24-2574f96e0cce None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:07.216026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b8ec-8356-4cb7-ba24-2574f96e0cce None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:07.216322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b8ec-8356-4cb7-ba24-2574f96e0cce None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/757ad5baa909451d94dd1eced0407d50/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:07.231456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988b8ec-8356-4cb7-ba24-2574f96e0cce None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=757ad5baa909451d94dd1eced0407d50, role_id=1beb7c9ed4094a7d9a1fc9e83a8c252c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:07.233042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988b8ec-8356-4cb7-ba24-2574f96e0cce None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:07.246519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad5562-d1f5-4083-b3b5-550e424e140b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:07.285523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:07.286165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:07.286448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:07.286722 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:07.298580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:07.300211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:07.310548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 310/613] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:07 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/757ad5baa909451d94dd1eced0407d50/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:07.317703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:07.318763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:07.319639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:07.319639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:07.319639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:07.319639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 304/614] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:07.325478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b8ec-8356-4cb7-ba24-2574f96e0cce None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:07.435058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:07.480658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b8ec-8356-4cb7-ba24-2574f96e0cce None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:07.507543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:07.530869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:07.531567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:07.531912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:07.532249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:07.532995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:07.533365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:07.535515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:07.545354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:07.552083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 311/615] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:07.558300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:07.633940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3e06-fd17-4c5f-8f03-a2c863a92cc3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:07.678176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d393ce-918f-460d-8a71-715e944270ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:07.678903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d393ce-918f-460d-8a71-715e944270ee None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:07.679188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d393ce-918f-460d-8a71-715e944270ee None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:07.679463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d393ce-918f-460d-8a71-715e944270ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:07.687418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2996e69-2d91-4c26-8340-2ceec02bbc0b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:07.693497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d393ce-918f-460d-8a71-715e944270ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f0d393ce-918f-460d-8a71-715e944270ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:07.699577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:07.700782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:07.701840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:07.708364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 305/616] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:07.714294 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d393ce-918f-460d-8a71-715e944270ee None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:07.726604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:07.744565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:07.745269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:07.747203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:07.747572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:07.763433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:07.765015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:07.789356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:07.790599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:07.791769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:07.800853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 312/617] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:07.807413 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:07.919880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:07.936220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d393ce-918f-460d-8a71-715e944270ee None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:07.980645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:07.982192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:07.983910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:07.984256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:07.986377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:07.986747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:07.988263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.006003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5280bd4-238c-48d6-952c-3275524a428c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:08.008632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 306/618] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:08.023717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.052934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:08.053692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.054093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.054466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.055977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:08.056410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:08.057947 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.081792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 313/619] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 10:07:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:08.087988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.159326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:08.234249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f36f2-a665-492c-a98d-2084b48c678e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:08.243824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155305fb-00fe-4077-89e7-1d6575a8b441 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:08.270341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd6c74-f91b-4b84-a0eb-03e8c78e51c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:08.271016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6c74-f91b-4b84-a0eb-03e8c78e51c9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.271294 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6c74-f91b-4b84-a0eb-03e8c78e51c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.271564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6c74-f91b-4b84-a0eb-03e8c78e51c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.284467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9fd26-a968-4bf0-86a5-0bfb64b7f714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:08.284793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd6c74-f91b-4b84-a0eb-03e8c78e51c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:08.285631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd26-a968-4bf0-86a5-0bfb64b7f714 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.286095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd26-a968-4bf0-86a5-0bfb64b7f714 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.286324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd6c74-f91b-4b84-a0eb-03e8c78e51c9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.286819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9fd26-a968-4bf0-86a5-0bfb64b7f714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.299089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9fd26-a968-4bf0-86a5-0bfb64b7f714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:08.300818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9fd26-a968-4bf0-86a5-0bfb64b7f714 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a0dd6c74-f91b-4b84-a0eb-03e8c78e51c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:08.302453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:08.303410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:08.304410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:08.304410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:08.304410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:08.304410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 307/620] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:08.305392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea8593-7db1-4d9a-aafa-5db8de8f153b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.305805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea8593-7db1-4d9a-aafa-5db8de8f153b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.306159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea8593-7db1-4d9a-aafa-5db8de8f153b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.311880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 308/621] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:08.312828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea8593-7db1-4d9a-aafa-5db8de8f153b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-60e9fd26-a968-4bf0-86a5-0bfb64b7f714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:08.320519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:08.321494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:08.322402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:08.322402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:08.322402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:08.328680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:08.329148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 314/622] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:08.330604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597aa63-c8f2-44b7-b648-2d569288e4e7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.331102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597aa63-c8f2-44b7-b648-2d569288e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.331581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597aa63-c8f2-44b7-b648-2d569288e4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.350098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f597aa63-c8f2-44b7-b648-2d569288e4e7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:08.351652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f597aa63-c8f2-44b7-b648-2d569288e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:08.425010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 315/623] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:08.425858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597aa63-c8f2-44b7-b648-2d569288e4e7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.434137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea8593-7db1-4d9a-aafa-5db8de8f153b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:08.450346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:08.497514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:08.498195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.498478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.498749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.499403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:08.499703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:08.501166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.522150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 309/624] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:08.533386 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597aa63-c8f2-44b7-b648-2d569288e4e7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:08.537055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.572182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:08.572905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.573249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.573588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.574315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:08.574679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:08.576219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.589642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 316/625] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:08.596121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.692822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:08.694068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:08.710309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabec31-6199-4f14-b12d-6745da3f6aa8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:08.746672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:08.747420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.747792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.748138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.756207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:08.757820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:08.770048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:08.772055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:08.774791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 317/626] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:08.780600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412e60f-3d4a-4a2c-b7b6-7eddee641cb9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:08.782171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.838774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:08.839158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.839442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.839712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.848000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:08.849752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:08.861952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:08.864140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 310/627] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:08.866586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.902055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53832b9b-86db-4599-ba27-1ef50a4c3167 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:08.937839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:08.939275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:08.939563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:08.939843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:08.941017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:08.941330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:08.942776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:08.960885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 318/628] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:08.961851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:08.966377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:08.975175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35ad8c-7285-44b9-bebd-a23635153392 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:09.004576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:09.016882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879da49-a50d-4087-aafb-8e1753d3b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:09.017775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879da49-a50d-4087-aafb-8e1753d3b342 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.018057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879da49-a50d-4087-aafb-8e1753d3b342 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.023962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879da49-a50d-4087-aafb-8e1753d3b342 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.033052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879da49-a50d-4087-aafb-8e1753d3b342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c879da49-a50d-4087-aafb-8e1753d3b342 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:09.039296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:09.040496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:09.041351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:09.044567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 311/629] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:09.045673 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879da49-a50d-4087-aafb-8e1753d3b342 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:09.085232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152ed06-f7fb-4efa-85a5-b433088d0c0f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:09.121811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:09.122418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.122698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.123027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.123754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:09.124056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:09.125673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:09.152602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 319/630] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:07:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:09.153880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:09.178219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879da49-a50d-4087-aafb-8e1753d3b342 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:09.214953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e3226-9eb9-4146-a186-f74fc8a11b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:09.215916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e3226-9eb9-4146-a186-f74fc8a11b87 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.216409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e3226-9eb9-4146-a186-f74fc8a11b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.216886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e3226-9eb9-4146-a186-f74fc8a11b87 None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/00dd24daa5374b85adbca9b16b807537/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.229041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:09.233000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e3226-9eb9-4146-a186-f74fc8a11b87 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=00dd24daa5374b85adbca9b16b807537, role_id=1beb7c9ed4094a7d9a1fc9e83a8c252c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:09.234545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e3226-9eb9-4146-a186-f74fc8a11b87 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:09.268738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6b798-fd01-4bdb-b9ea-d89e1be8f86d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:09.302561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:09.303101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.303384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.303658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.304343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:09.304654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:09.306534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:09.314524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 320/631] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:09.315345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:09.324917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 312/632] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:09 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/00dd24daa5374b85adbca9b16b807537/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:09.333972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ede2a-a073-4d05-a27e-3005829dcca8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.339056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ede2a-a073-4d05-a27e-3005829dcca8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.339056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ede2a-a073-4d05-a27e-3005829dcca8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.339056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 313/633] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:09.339056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ede2a-a073-4d05-a27e-3005829dcca8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:09.388966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:09.469103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ede2a-a073-4d05-a27e-3005829dcca8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:09.471250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af4e32-9770-4751-bfc5-f5735e1b264f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:09.508885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:09.522086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcf39c-7357-4cc6-9111-789f03f86a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:09.522824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf39c-7357-4cc6-9111-789f03f86a63 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.523601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf39c-7357-4cc6-9111-789f03f86a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.524571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcf39c-7357-4cc6-9111-789f03f86a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.529431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445eae7-f05c-46ee-86d8-5cea06b7961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:09.530042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445eae7-f05c-46ee-86d8-5cea06b7961d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.530324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445eae7-f05c-46ee-86d8-5cea06b7961d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.530598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445eae7-f05c-46ee-86d8-5cea06b7961d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.540663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcf39c-7357-4cc6-9111-789f03f86a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:09.542158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcf39c-7357-4cc6-9111-789f03f86a63 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-53bcf39c-7357-4cc6-9111-789f03f86a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:09.557918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:09.558935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:09.559847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:09.559847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:09.559847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:09.559847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 314/634] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:09.560650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1aac-a412-48db-b70d-347dfc06e38f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.560930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1aac-a412-48db-b70d-347dfc06e38f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.561203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1aac-a412-48db-b70d-347dfc06e38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.582477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-26af1aac-a412-48db-b70d-347dfc06e38f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:09.583129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-26af1aac-a412-48db-b70d-347dfc06e38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:09.626760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445eae7-f05c-46ee-86d8-5cea06b7961d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:09.629479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445eae7-f05c-46ee-86d8-5cea06b7961d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:09.657096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 315/635] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:09.658065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af1aac-a412-48db-b70d-347dfc06e38f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:09.682690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:09.769236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af1aac-a412-48db-b70d-347dfc06e38f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:09.770973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 321/636] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:07:09.772496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348453c6-bcec-4bd5-8e87-6a6dd4d1f97b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.772991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348453c6-bcec-4bd5-8e87-6a6dd4d1f97b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.773496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348453c6-bcec-4bd5-8e87-6a6dd4d1f97b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.776098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 322/637] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:09.778132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348453c6-bcec-4bd5-8e87-6a6dd4d1f97b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:09.812565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779de47-d554-439e-93e9-fbd72d62eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:09.812985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779de47-d554-439e-93e9-fbd72d62eb91 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.813265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779de47-d554-439e-93e9-fbd72d62eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.813538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779de47-d554-439e-93e9-fbd72d62eb91 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.814235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779de47-d554-439e-93e9-fbd72d62eb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:09.814489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779de47-d554-439e-93e9-fbd72d62eb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:09.815992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779de47-d554-439e-93e9-fbd72d62eb91 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:09.828980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:09.842426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 316/638] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:09.842585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e8eef-da85-4baf-aec5-b4a1fb974f7c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.843015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e8eef-da85-4baf-aec5-b4a1fb974f7c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.847136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e8eef-da85-4baf-aec5-b4a1fb974f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.862323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f90e8eef-da85-4baf-aec5-b4a1fb974f7c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:09.863507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f90e8eef-da85-4baf-aec5-b4a1fb974f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:09.921558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348453c6-bcec-4bd5-8e87-6a6dd4d1f97b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:09.948338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 317/639] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:09.951268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e8eef-da85-4baf-aec5-b4a1fb974f7c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:09.959861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:09.960529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:09.962315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:09.962927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:09.963302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:09.973858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:09.975588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:09.991487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:09.992859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:09.994174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:09.994174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:09.994174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:10.000008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 323/640] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:10.000992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.073799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e8eef-da85-4baf-aec5-b4a1fb974f7c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.101082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:10.118661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.119730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.120459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.120834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.126378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abdf90-bace-4336-942d-27e3053ef96e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.131200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:10.132761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:10.150586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:10.151768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 10:07:10.152973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:10.153663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 318/641] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:10.158280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.169740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c7001-e47e-4616-84d6-c1bf4eb6da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.170499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c7001-e47e-4616-84d6-c1bf4eb6da1b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.170932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c7001-e47e-4616-84d6-c1bf4eb6da1b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.171311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c7001-e47e-4616-84d6-c1bf4eb6da1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.182848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c7001-e47e-4616-84d6-c1bf4eb6da1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c07c7001-e47e-4616-84d6-c1bf4eb6da1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:10.188657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:10.189883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:10.190984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:10.198116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 324/642] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:10.199142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c7001-e47e-4616-84d6-c1bf4eb6da1b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.240733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:10.281909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee2829-8b5b-4429-b95d-857998818141 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.304850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c7001-e47e-4616-84d6-c1bf4eb6da1b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.317955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.318565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.319188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.319461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.320470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:10.321320 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:10.322899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:10.340713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 319/643] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:10.340713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.351326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.352056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.352519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.352878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.353740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:10.354089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:10.355470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:10.359042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:10.376510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 325/644] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:10.378291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.442564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a221cb-df2c-44d4-bd84-8c1717e32897 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.471994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:10.479794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.480429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.480707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.480976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.481641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:10.481940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:10.483305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:10.491167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 320/645] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:10.491934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.501345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f31f-eff6-458a-995b-8244ff60189e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.537645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e935-84e5-49ec-a938-2f9d74a3b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.538692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e935-84e5-49ec-a938-2f9d74a3b72a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.538803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e935-84e5-49ec-a938-2f9d74a3b72a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.539039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073e935-84e5-49ec-a938-2f9d74a3b72a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.550322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073e935-84e5-49ec-a938-2f9d74a3b72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-b073e935-84e5-49ec-a938-2f9d74a3b72a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:10.555690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:10.556906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 326/646] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:10.557894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e935-84e5-49ec-a938-2f9d74a3b72a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.602138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019867c-4799-4192-a015-334b226be0e3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.614634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:10.637404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.638029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.638310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.638577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.645149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:10.646651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:10.658084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:10.659025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 321/647] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:10.659950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.667719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073e935-84e5-49ec-a938-2f9d74a3b72a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.709987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3aecf-3daf-42f9-9692-334f8d42f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.710757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3aecf-3daf-42f9-9692-334f8d42f157 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.711103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3aecf-3daf-42f9-9692-334f8d42f157 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.711483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3aecf-3daf-42f9-9692-334f8d42f157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.715923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:10.771231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743afe45-e7e6-4cde-bde2-c8b954dd50c3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.788134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3aecf-3daf-42f9-9692-334f8d42f157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:10.789917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3aecf-3daf-42f9-9692-334f8d42f157 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:10.806595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16872b53-9e01-4254-8a96-09535444211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.807218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16872b53-9e01-4254-8a96-09535444211e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:10.807492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16872b53-9e01-4254-8a96-09535444211e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:10.807758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16872b53-9e01-4254-8a96-09535444211e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:10.819177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16872b53-9e01-4254-8a96-09535444211e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:10.820654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16872b53-9e01-4254-8a96-09535444211e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-16872b53-9e01-4254-8a96-09535444211e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:10.835734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:10.837131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:10.838075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:10.838075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:10.838075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:10.841406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 322/648] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:10.842128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16872b53-9e01-4254-8a96-09535444211e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.852841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:10.904901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 327/649] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:07:10.906087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3aecf-3daf-42f9-9692-334f8d42f157 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:10.961362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16872b53-9e01-4254-8a96-09535444211e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:10.963053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:10.998479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:10.999681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.000154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.000790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.001963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:11.002684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.004747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.010755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3aecf-3daf-42f9-9692-334f8d42f157 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.015896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 323/650] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:11.016959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.046871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.047479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.047760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.048034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.048752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:11.049057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.050477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.062726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 328/651] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:11.063535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.079913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:11.132689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8772be-80da-410a-92ca-243dfb80c775 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.166877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.167487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.167766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.168045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.168749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:11.169114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.170500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.171135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c891fa-85e4-469a-8ac8-324347d49b8d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.187218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 324/652] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:11.187218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.210496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.210891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:11.211135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.211918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.212205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.222574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.224020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:11.240625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:11.241627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:11.242544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:11.242544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:11.242544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:11.242544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 329/653] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:11.242544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.292910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3913942-5e70-4169-9a32-23a7f384d086 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.311744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:11.326052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.326683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.326971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.327234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.337769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.339208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.345280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac097188-dd0e-46ed-bd6e-1e4976ce4a3f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:11.353822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:11.354916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:11.356226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:11.356226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:11.356226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:11.356226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 325/654] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:11.356226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.382111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.382766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.382995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.383268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.383989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=7e8ce142e0c944b49053bd2a44ce4853) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:11.384310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.385752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.391305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 330/655] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/role_assignments?user.id=7e8ce142e0c944b49053bd2a44ce4853&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:11.392075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.440326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:11.465923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf74b0-f41e-4272-967d-04f49187a71e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.505733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69294b2-7f24-4049-9b5e-b9cf6d6e6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.506257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc112776-bbcd-4f5d-af31-f4046f501c16 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.506397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69294b2-7f24-4049-9b5e-b9cf6d6e6227 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.506641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69294b2-7f24-4049-9b5e-b9cf6d6e6227 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.506909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69294b2-7f24-4049-9b5e-b9cf6d6e6227 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.516056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69294b2-7f24-4049-9b5e-b9cf6d6e6227 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.517614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69294b2-7f24-4049-9b5e-b9cf6d6e6227 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b69294b2-7f24-4049-9b5e-b9cf6d6e6227 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:11.530133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:11.531169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:11.532126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 326/656] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:11.532961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b0f90-11f0-4af3-9059-1677bada5efa None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.533028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b0f90-11f0-4af3-9059-1677bada5efa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.533351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b0f90-11f0-4af3-9059-1677bada5efa None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.534610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 327/657] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:11.535156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b0f90-11f0-4af3-9059-1677bada5efa None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.545469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:11.556429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.557159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.557486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.557775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.563398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:11.563398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.563398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.572694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 331/658] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:11.573925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.654428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b0f90-11f0-4af3-9059-1677bada5efa None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.688698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56369e15-e56b-45fb-a83d-b6a3ea26ad24 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.692675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb0485-c8c5-4f0c-a033-94541f6992f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.693276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0485-c8c5-4f0c-a033-94541f6992f9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.693549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0485-c8c5-4f0c-a033-94541f6992f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.693814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0485-c8c5-4f0c-a033-94541f6992f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.694459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb0485-c8c5-4f0c-a033-94541f6992f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:11.694756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb0485-c8c5-4f0c-a033-94541f6992f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.696195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb0485-c8c5-4f0c-a033-94541f6992f9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.698724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:11.707821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 328/659] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:11.709356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ff22-fea0-4db2-959d-a595d7fa3631 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.712184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ff22-fea0-4db2-959d-a595d7fa3631 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.712184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4ff22-fea0-4db2-959d-a595d7fa3631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.728556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4cc4ff22-fea0-4db2-959d-a595d7fa3631 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:11.730371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.730639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4cc4ff22-fea0-4db2-959d-a595d7fa3631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:11.730974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.731251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.731520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.732242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:11.732590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.733994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.757192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 332/660] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:11.757192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.807019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 329/661] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:11.808269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ff22-fea0-4db2-959d-a595d7fa3631 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.819822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:11.884821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607c0da-f15b-4396-bef6-764ac217cb80 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.923380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.924099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.924944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.925323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.935052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.937256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:11.938054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4ff22-fea0-4db2-959d-a595d7fa3631 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:11.952065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:11.953157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:11.954169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:11.954169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:11.954169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:11.954169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:11.954169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:11.954169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:11.954169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:11.954169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:11.956317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 333/662] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:11.957183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:11.972420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:11.982377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:11.993914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:11.993914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:11.993914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:11.993914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:11.993914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:12.006139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:12.007271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 10:07:12.008570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:12.011865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 330/663] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:12.011865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.071841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8f403-19e7-44e8-b470-874f86fee3b6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:12.081383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:12.108535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95433eea-bebc-46a0-8fdd-a4d1daea188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:12.109541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95433eea-bebc-46a0-8fdd-a4d1daea188a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:12.110068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95433eea-bebc-46a0-8fdd-a4d1daea188a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:12.110548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95433eea-bebc-46a0-8fdd-a4d1daea188a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:12.121741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88da058-e3d1-4753-b5ac-89e15d3376bc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:12.155038 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:12.155638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:12.155914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:12.156185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:12.156902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:12.157208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:12.158646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:12.171094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 331/664] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:12.171870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.191669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95433eea-bebc-46a0-8fdd-a4d1daea188a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:12.193525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95433eea-bebc-46a0-8fdd-a4d1daea188a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:12.218846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:12.274437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36da26-7cef-4b06-8709-ffda5e58acd3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:12.299567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 334/665] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:07:12.300582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95433eea-bebc-46a0-8fdd-a4d1daea188a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.314020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:12.318867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:12.319481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:12.319754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:12.320022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:12.321340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:12.321642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:12.326991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:12.345059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 332/666] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:12.345926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.411168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95433eea-bebc-46a0-8fdd-a4d1daea188a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:12.451544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7913004-805c-4710-8ab6-c5f6bf4d06aa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:12.451848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310683-7231-40bf-a41a-236d2dffd0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:12.452462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310683-7231-40bf-a41a-236d2dffd0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:12.452739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310683-7231-40bf-a41a-236d2dffd0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:12.453008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e310683-7231-40bf-a41a-236d2dffd0d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:12.454951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:12.463316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e310683-7231-40bf-a41a-236d2dffd0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9e310683-7231-40bf-a41a-236d2dffd0d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:12.468166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:12.469133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:12.470148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 335/667] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:12.474671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310683-7231-40bf-a41a-236d2dffd0d4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.493370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:12.493985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:12.494249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:12.494518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:12.495248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=4b03cdf17a244cf094a7ce93775da22c) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:12.495556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:12.497010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:12.512325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 333/668] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/role_assignments?user.id=4b03cdf17a244cf094a7ce93775da22c&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:12.512325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.584568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:12.615829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e310683-7231-40bf-a41a-236d2dffd0d4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:12.630998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81111329-6734-4c9b-98df-6019b62821bf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:12.655549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:12.656577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:12.657046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:12.657523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:12.669839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3ed94-e6ba-4d6c-b546-60580cd30d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:12.670454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ed94-e6ba-4d6c-b546-60580cd30d17 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:12.670736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ed94-e6ba-4d6c-b546-60580cd30d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:12.671005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3ed94-e6ba-4d6c-b546-60580cd30d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:12.672180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:12.673863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:12.691684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:12.693193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:12.694133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:12.694133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:12.694133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:12.694133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 336/669] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:12.694133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.736043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:12.777636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3ed94-e6ba-4d6c-b546-60580cd30d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:12.780207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3ed94-e6ba-4d6c-b546-60580cd30d17 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:12.834029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb17068-c488-4733-9824-a98d470d284f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:12.856673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:12.870608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:12.876705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:12.876705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:12.876705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:12.876705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:12.876705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:12.876705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:12.890329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 337/670] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:12.891459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.911484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 334/671] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:07:12.912860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3ed94-e6ba-4d6c-b546-60580cd30d17 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:12.987534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:13.020880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2aaa7-7496-4ca4-95be-285296abd63a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.027313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3ed94-e6ba-4d6c-b546-60580cd30d17 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.064064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.064976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.065414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.065828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.069460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.070072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.070355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.071164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.071890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:13.072200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.073615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.079044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.080708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.092669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 338/672] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:13.100816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:13.101062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:13.102376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:13.103323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:13.103323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:13.103323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:13.108534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 335/673] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:13.109547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.147902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:13.222901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9723-028e-4160-a5bc-b392ba2be466 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.226045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80927-96bc-4191-b956-d2a47e670b66 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.254473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:13.262230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.263094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.268711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.268711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.273432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.274869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.275316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.275592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.275882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.277440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.283304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.286434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:13.295292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:13.296476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:13.297633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:13.297633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:13.297633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:13.304331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 339/674] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:13.304331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:13.306467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:13.308451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 336/675] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:13.310379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.415643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:13.423058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5df84b-d5ad-4158-9cb1-b3238b7b6c33 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.438154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499f283-7a6b-470b-bc5e-f5cadc41b673 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.460066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.460856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.461082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.462033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.462828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:13.463354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.464793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.473751 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731906d-a6af-4b6c-8d9a-239a6705e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.474365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731906d-a6af-4b6c-8d9a-239a6705e687 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.475092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731906d-a6af-4b6c-8d9a-239a6705e687 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.475374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731906d-a6af-4b6c-8d9a-239a6705e687 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.476027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731906d-a6af-4b6c-8d9a-239a6705e687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:13.476362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731906d-a6af-4b6c-8d9a-239a6705e687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.483001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 340/676] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:13.483141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731906d-a6af-4b6c-8d9a-239a6705e687 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.483238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.490587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 337/677] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:13.495408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb904-a31a-4e5f-a041-0c30d0409498 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.495408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb904-a31a-4e5f-a041-0c30d0409498 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.495408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fb904-a31a-4e5f-a041-0c30d0409498 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.495408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 338/678] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:13.495408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fb904-a31a-4e5f-a041-0c30d0409498 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.540786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:13.596550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4854b2-96ce-4a40-b1a9-489f55b68e5a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.605398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fb904-a31a-4e5f-a041-0c30d0409498 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.631054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.631660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.631942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.632216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.632935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:13.633781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.635202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.642814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e26be-2be5-4df4-86a3-e1e2082c3cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.643505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e26be-2be5-4df4-86a3-e1e2082c3cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.643788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e26be-2be5-4df4-86a3-e1e2082c3cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.644053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e26be-2be5-4df4-86a3-e1e2082c3cb9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.647616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 341/679] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:13.648531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.654882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e26be-2be5-4df4-86a3-e1e2082c3cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.656391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e26be-2be5-4df4-86a3-e1e2082c3cb9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.664662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-dc3e26be-2be5-4df4-86a3-e1e2082c3cb9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:13.669551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:13.676198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 339/680] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11a8e-52bf-41b9-9028-982efc6b8a2f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.682093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11a8e-52bf-41b9-9028-982efc6b8a2f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.682966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de11a8e-52bf-41b9-9028-982efc6b8a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.691648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8de11a8e-52bf-41b9-9028-982efc6b8a2f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:13.693015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8de11a8e-52bf-41b9-9028-982efc6b8a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:13.764729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 340/681] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:13.765576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de11a8e-52bf-41b9-9028-982efc6b8a2f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.766042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f671eee-537f-4b2e-a7cb-7413e713cad5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.803660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:13.810302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.811053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.811392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.811669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.818757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.820248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:13.835797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:13.837307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:13.838221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:13.838221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:13.838221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:13.838221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:13.838221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:13.838221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:13.838221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:13.838221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:13.842864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 342/682] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:13.843953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.889953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de11a8e-52bf-41b9-9028-982efc6b8a2f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.921100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:13.929214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.930703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.931180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.931615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.932546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=00283447a1a6405b952e541a13c91110) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:13.943631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.943631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:13.943631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 341/683] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/role_assignments?user.id=00283447a1a6405b952e541a13c91110&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:13.943631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:13.947585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee501999-97a8-4ad1-842f-1f64fae425e2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:13.987033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:13.987678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:13.987953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:13.988223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:13.989176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:13.989483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:13.990926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:14.012209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 343/684] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:14.017947 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:14.108846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:14.116063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8db884-8065-441c-9afa-cd281910179f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:14.132621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538788-85de-4054-8994-2b20a93ae621 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:14.152330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:14.156277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.156277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.156277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.156277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:14.156277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:14.156277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:14.167578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:14.175076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 342/685] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:14.175076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:14.177593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998746b2-1277-4d06-b9c5-180de2e98579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:14.178451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998746b2-1277-4d06-b9c5-180de2e98579 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.178734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998746b2-1277-4d06-b9c5-180de2e98579 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.180758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998746b2-1277-4d06-b9c5-180de2e98579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.264542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998746b2-1277-4d06-b9c5-180de2e98579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:14.265999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998746b2-1277-4d06-b9c5-180de2e98579 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:14.301613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416aa41-c831-45b0-9388-c42ff0f91703 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:14.339647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344af271-92ac-4b4b-a628-f4d43b244dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:14.340275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344af271-92ac-4b4b-a628-f4d43b244dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.340634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344af271-92ac-4b4b-a628-f4d43b244dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.340910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344af271-92ac-4b4b-a628-f4d43b244dc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.356178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344af271-92ac-4b4b-a628-f4d43b244dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-344af271-92ac-4b4b-a628-f4d43b244dc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:14.364172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:14.365245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:14.366172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:14.370203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 343/686] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:14.374888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344af271-92ac-4b4b-a628-f4d43b244dc5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:14.391969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:14.411205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 344/687] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:07:14.412376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998746b2-1277-4d06-b9c5-180de2e98579 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:14.459301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:14.506818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344af271-92ac-4b4b-a628-f4d43b244dc5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:14.537699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998746b2-1277-4d06-b9c5-180de2e98579 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:14.556534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:14.557897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.558392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.558896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.560409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=757ad5baa909451d94dd1eced0407d50) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:14.561008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:14.563677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:14.573222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 344/688] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:14 2022] GET /identity/v3/role_assignments?user.id=757ad5baa909451d94dd1eced0407d50&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:14.574224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:14.575479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae17746-9f79-474a-a4dc-00b59e313c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:14.576339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17746-9f79-474a-a4dc-00b59e313c6b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.576778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17746-9f79-474a-a4dc-00b59e313c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.577206 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17746-9f79-474a-a4dc-00b59e313c6b None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.578117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae17746-9f79-474a-a4dc-00b59e313c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:14.578641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae17746-9f79-474a-a4dc-00b59e313c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:14.580255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae17746-9f79-474a-a4dc-00b59e313c6b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:14.591327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 345/689] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:14.593104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104f70-f85b-467e-905f-eae81d0bcdd3 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.593654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104f70-f85b-467e-905f-eae81d0bcdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.594138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104f70-f85b-467e-905f-eae81d0bcdd3 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.595707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 346/690] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:14.597015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104f70-f85b-467e-905f-eae81d0bcdd3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:14.690577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:14.713822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38547999-738b-42f0-a6b3-ef54e2b89fcf None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:14.766900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78834-6566-45e6-8b6e-760889c44ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:14.767655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78834-6566-45e6-8b6e-760889c44ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.767949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78834-6566-45e6-8b6e-760889c44ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.768225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78834-6566-45e6-8b6e-760889c44ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.780781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f78834-6566-45e6-8b6e-760889c44ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:14.782272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f78834-6566-45e6-8b6e-760889c44ce1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-29f78834-6566-45e6-8b6e-760889c44ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:14.799198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:14.800250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:14.801304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:14.801304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:14.801304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:14.801304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 345/691] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:14.801568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7bd9-6cb0-4f22-85a7-7b4cd212de3f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.808154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7bd9-6cb0-4f22-85a7-7b4cd212de3f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.808154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7bd9-6cb0-4f22-85a7-7b4cd212de3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.823518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-949f7bd9-6cb0-4f22-85a7-7b4cd212de3f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:14.824767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-949f7bd9-6cb0-4f22-85a7-7b4cd212de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:14.857874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:14.868788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104f70-f85b-467e-905f-eae81d0bcdd3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:14.915476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:14.916805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:14.917090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:14.917364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:14.923868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 346/692] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:14.928554 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7bd9-6cb0-4f22-85a7-7b4cd212de3f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:14.938556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:14.940331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:14.973785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:14.974866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:14.975787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:14.975787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:14.975787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:14.984652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 347/693] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:14.985712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.003282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:15.047661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7bd9-6cb0-4f22-85a7-7b4cd212de3f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.108977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.110737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.111454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.113009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.113900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:15.115096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.116808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.142338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 347/694] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:15.150998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.173278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b67e5d-3e95-4090-a681-c02acb8662ce None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.233482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.233935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.234212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.234478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.235122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:15.235410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.236808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.255741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 348/695] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:15.256682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.271073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:15.275276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a3b2b-81ef-4822-9cd8-12f25cb903c6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.296494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:15.310896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.311543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.311813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.312089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.320977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.323086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:15.337392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:15.338563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:15.339663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:15.339663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:15.339663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:15.339663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:15.339663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:15.339663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:15.339663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:15.339663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:15.341364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 348/696] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:15.342269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.389934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e1140-1a6d-4e60-9958-e33eb49374be None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.434873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.435742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.436191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.436698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.437938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.439723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:15.452486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:15.453740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:15.454824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:15.456065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259e890-1fb5-4c98-8985-2528e93ac600 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.456895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 349/697] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:15.457766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.502456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.502456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.502973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.503345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.511190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.512806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:15.524502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:15.525652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:15.526773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:15.532033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 349/698] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:15.532889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.548581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:15.578932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:15.590155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d7c62-daf4-401d-acbf-ad63a62ad6bb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.632384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.633607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.633953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.634286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.635050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:15.635469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.637028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.649790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 350/699] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:15.650478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73ef46-1a14-46f8-b88e-c73463d22cff None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.650743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.694505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.696083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.696540 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.697264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.698343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:15.698793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.700490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.706987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 350/700] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:15.708033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.767304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e97371-73f7-4dab-bba3-0f61cf9cc56f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.805558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:15.813842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.814606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.814895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.815166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.815900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:15.816641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.818355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.823428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7073afb-3ac5-4eb3-bbd4-82b3feb0ab4f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:15.827678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:15.851545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 351/701] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:15.853466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.867215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:15.868219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:15.868750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:15.869231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:15.870172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=00dd24daa5374b85adbca9b16b807537) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:15.870689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:15.872352 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:15.884422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 351/702] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/role_assignments?user.id=00dd24daa5374b85adbca9b16b807537&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:15.885719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:15.977928 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5576d2-7e9f-4b5d-9150-5c5bc65f097d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:16.017120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d6ac8-85d6-4eef-bb34-d3e33e7ccfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:16.018093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6ac8-85d6-4eef-bb34-d3e33e7ccfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:16.018307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6ac8-85d6-4eef-bb34-d3e33e7ccfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:16.018579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d6ac8-85d6-4eef-bb34-d3e33e7ccfe5 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:16.019402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d6ac8-85d6-4eef-bb34-d3e33e7ccfe5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:16.019709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d6ac8-85d6-4eef-bb34-d3e33e7ccfe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:16.021104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d6ac8-85d6-4eef-bb34-d3e33e7ccfe5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:16.028887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 352/703] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:16.109405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f75b07-5c14-4be4-a8ae-04444460b2bd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:16.154094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea18df-b985-442e-9020-87620a440afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:16.154725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea18df-b985-442e-9020-87620a440afb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:16.155012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea18df-b985-442e-9020-87620a440afb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:16.155280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea18df-b985-442e-9020-87620a440afb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:16.195169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:16.233430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea18df-b985-442e-9020-87620a440afb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:16.234908 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea18df-b985-442e-9020-87620a440afb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:16.236955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde389-c60b-4c98-84d6-bbdb8892ffa0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:16.237342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde389-c60b-4c98-84d6-bbdb8892ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:16.237712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde389-c60b-4c98-84d6-bbdb8892ffa0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:16.240924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 353/704] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:16.244782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdc5d-2e9a-4479-85a9-306b22d452ec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:16.245224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdc5d-2e9a-4479-85a9-306b22d452ec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:16.245593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fdc5d-2e9a-4479-85a9-306b22d452ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:16.269016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8c3fdc5d-2e9a-4479-85a9-306b22d452ec None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:16.270271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c3fdc5d-2e9a-4479-85a9-306b22d452ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:16.342215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:16.345986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 352/705] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:07:16.353305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea18df-b985-442e-9020-87620a440afb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:16.362589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 354/706] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:16.554827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:16.599267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea18df-b985-442e-9020-87620a440afb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:16.639832 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275d9f-d307-40e0-ad15-176e942cf3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:16.640495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d9f-d307-40e0-ad15-176e942cf3bd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:16.640772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d9f-d307-40e0-ad15-176e942cf3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:16.641040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275d9f-d307-40e0-ad15-176e942cf3bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:16.652486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275d9f-d307-40e0-ad15-176e942cf3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:16.653943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275d9f-d307-40e0-ad15-176e942cf3bd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5c275d9f-d307-40e0-ad15-176e942cf3bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:16.675483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:16.676536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:16.677436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:16.677436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:16.677436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:16.680592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 353/707] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:16.686108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fdc5d-2e9a-4479-85a9-306b22d452ec None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:16.751334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0728-04a8-4878-84dc-5742c3ec0927 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:16.752733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0728-04a8-4878-84dc-5742c3ec0927 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:16.753251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0728-04a8-4878-84dc-5742c3ec0927 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:16.755028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 354/708] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:16.761472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377909-18bb-43dd-b617-841b8dfc6ced None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:16.762035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377909-18bb-43dd-b617-841b8dfc6ced None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:16.762516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377909-18bb-43dd-b617-841b8dfc6ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:16.784927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-76377909-18bb-43dd-b617-841b8dfc6ced None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:16.786701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-76377909-18bb-43dd-b617-841b8dfc6ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:16.828100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fdc5d-2e9a-4479-85a9-306b22d452ec None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:16.869803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:16.870708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:16.871140 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:16.871561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:16.872460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:16.872909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:16.874424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:16.879685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 355/709] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 10:07:16.885718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76377909-18bb-43dd-b617-841b8dfc6ced None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:16.893944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 355/710] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:16.899846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:16.977810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:16.986500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:17.076762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76377909-18bb-43dd-b617-841b8dfc6ced None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:17.089479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26113bbf-df42-460c-8333-f80a9bdb5b73 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:17.133574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:17.135988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:17.136267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:17.136561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:17.152679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:17.153313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:17.153591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:17.153865 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:17.157653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:17.159119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:17.166817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:17.168244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:17.188485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:17.189428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:17.190336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 356/711] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:17.194836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:17.196422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:17.197360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:17.197360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:17.197360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:17.200765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 356/712] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:17.201710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:17.208925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:17.341364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd02c9-04b1-4b31-a368-d624062e9b45 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:17.342920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:17.361970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47033130-0241-4ef7-b588-3bce8246a879 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:17.363574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:17.377998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:17.378687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:17.380067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:17.380512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:17.381260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:17.381625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:17.383663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:17.396399 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 357/713] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:17.397516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:17.400622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:17.401533 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:17.402034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:17.402516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:17.403491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:17.404050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:17.405893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:17.419930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 357/714] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:17.421162 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:17.505603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fa9af-e25e-48b4-af5c-eea6bec71485 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:17.529050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3e6fe-347a-49f9-8182-d4c752c42c93 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:17.541194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:17.541808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:17.542081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:17.542351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] PATH_INFO: `/v3/services/network` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:17.542941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:17.544321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:17.556618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:17.557693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:17.559153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 358/715] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:17 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:17.559992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:17.571519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c47ac-fcab-4e60-9c82-e2e52705962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:17.572551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c47ac-fcab-4e60-9c82-e2e52705962b None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:17.573196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c47ac-fcab-4e60-9c82-e2e52705962b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:17.573678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c47ac-fcab-4e60-9c82-e2e52705962b None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:17.574529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c47ac-fcab-4e60-9c82-e2e52705962b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:17.576213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c47ac-fcab-4e60-9c82-e2e52705962b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:17.588005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:17.661592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99246196-5c7e-42c0-ac07-3b3d7c6c6341 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:17.696663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:17.697260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:17.697536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:17.697804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:17.698525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=7e8ce142e0c944b49053bd2a44ce4853) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:17.698830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:17.700497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:17.716342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 358/716] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:07:17 2022] POST /identity/v3/users => generated 254 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:17.716342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c47ac-fcab-4e60-9c82-e2e52705962b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:17.719281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 359/717] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:17 2022] GET /identity/v3/role_assignments?user.id=7e8ce142e0c944b49053bd2a44ce4853&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=fe95a036fa044c4bb408b793fba6436a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:17.758156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:17.904493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c47ac-fcab-4e60-9c82-e2e52705962b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:17.947437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22ac22-1f2c-48d9-8c8a-5910cfb60773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:17.947980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22ac22-1f2c-48d9-8c8a-5910cfb60773 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:17.948258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22ac22-1f2c-48d9-8c8a-5910cfb60773 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:17.948552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22ac22-1f2c-48d9-8c8a-5910cfb60773 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:17.949189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22ac22-1f2c-48d9-8c8a-5910cfb60773 None admin] RBAC: Adding query filter params (name=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:17.949487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22ac22-1f2c-48d9-8c8a-5910cfb60773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:17.950853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22ac22-1f2c-48d9-8c8a-5910cfb60773 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:17.955920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 359/718] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:17.961770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:18.061336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:18.071240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b8141-5f1f-43ac-b6e0-da594d0f10d2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:18.114366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e9a5-b39e-48cc-afa8-d5669736779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:18.114977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e9a5-b39e-48cc-afa8-d5669736779d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:18.115253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e9a5-b39e-48cc-afa8-d5669736779d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:18.115525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e9a5-b39e-48cc-afa8-d5669736779d None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:18.116169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e9a5-b39e-48cc-afa8-d5669736779d None admin] RBAC: Adding query filter params (type=network) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:18.116513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e9a5-b39e-48cc-afa8-d5669736779d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:18.118344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74e9a5-b39e-48cc-afa8-d5669736779d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:18.124513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 360/719] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:18.207474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba576-61c9-4a3e-bb66-c4b373aa97e8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:18.207993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba576-61c9-4a3e-bb66-c4b373aa97e8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:18.207993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cba576-61c9-4a3e-bb66-c4b373aa97e8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:18.209624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 360/720] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:18.217219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e0ac0-5020-4f85-9021-5bc8560fc594 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:18.217549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e0ac0-5020-4f85-9021-5bc8560fc594 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:18.217774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e0ac0-5020-4f85-9021-5bc8560fc594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:18.241874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-673e0ac0-5020-4f85-9021-5bc8560fc594 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:18.243600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-673e0ac0-5020-4f85-9021-5bc8560fc594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:18.337627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 361/721] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:18.507469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208658b-3251-4e9f-9a6b-69fcdcd96763 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:18.507643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208658b-3251-4e9f-9a6b-69fcdcd96763 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:18.507988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208658b-3251-4e9f-9a6b-69fcdcd96763 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:18.510165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 361/722] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:18.516575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2325d-566d-4add-b6a6-fed958720a17 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:18.516859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2325d-566d-4add-b6a6-fed958720a17 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:18.517135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2325d-566d-4add-b6a6-fed958720a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:18.541314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-79c2325d-566d-4add-b6a6-fed958720a17 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:18.542655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-79c2325d-566d-4add-b6a6-fed958720a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:18.620086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 362/723] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:18.673873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208658b-3251-4e9f-9a6b-69fcdcd96763 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:18.760273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:18.779777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208658b-3251-4e9f-9a6b-69fcdcd96763 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:18.821064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df761a-df5e-4ff5-89ad-954e7e001302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:18.821726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df761a-df5e-4ff5-89ad-954e7e001302 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:18.822010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df761a-df5e-4ff5-89ad-954e7e001302 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:18.822281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df761a-df5e-4ff5-89ad-954e7e001302 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:18.822936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df761a-df5e-4ff5-89ad-954e7e001302 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:18.826966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df761a-df5e-4ff5-89ad-954e7e001302 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:18.919884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2325d-566d-4add-b6a6-fed958720a17 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:18.940888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:18.942213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 362/724] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:07:18 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:19.041135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2325d-566d-4add-b6a6-fed958720a17 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:19.089699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f2654-1575-441a-b35d-4ceabbf994b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:19.090353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2654-1575-441a-b35d-4ceabbf994b2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:19.090630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2654-1575-441a-b35d-4ceabbf994b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:19.090899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f2654-1575-441a-b35d-4ceabbf994b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:19.112761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f2654-1575-441a-b35d-4ceabbf994b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-486f2654-1575-441a-b35d-4ceabbf994b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:19.118893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:19.119897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:19.121389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 363/725] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:19.129448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df761a-df5e-4ff5-89ad-954e7e001302 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:19.255970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df761a-df5e-4ff5-89ad-954e7e001302 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:19.291640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:19.292696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:19.293184 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:19.293731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:19.294635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:19.295248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:19.296918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:19.307753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 363/726] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:19.313133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f2654-1575-441a-b35d-4ceabbf994b2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:19.405749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:19.449880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f2654-1575-441a-b35d-4ceabbf994b2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:19.490977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:19.491612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:19.491888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:19.492160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:19.503892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:19.505379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:19.524091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:19.525205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:19.526758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:19.526758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:19.526758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:19.526758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 364/727] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:19.530853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:19.546070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:19.675290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c8baf-27e4-4842-a002-13a8eb99a46f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:19.721995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:19.722996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:19.723503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:19.723993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:19.724877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:19.725394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:19.727521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:19.744331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 364/728] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:19.749324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:19.917120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b1341-1bce-4ae6-8dbd-891d12a7e13d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:19.952337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:19.962471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1b84c-e4ad-4892-85ed-5c4d2138cf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:19.972355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b84c-e4ad-4892-85ed-5c4d2138cf45 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:19.972355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b84c-e4ad-4892-85ed-5c4d2138cf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:19.972355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1b84c-e4ad-4892-85ed-5c4d2138cf45 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:19.972355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1b84c-e4ad-4892-85ed-5c4d2138cf45 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:19.973444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1b84c-e4ad-4892-85ed-5c4d2138cf45 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-bef1b84c-e4ad-4892-85ed-5c4d2138cf45 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:19.988346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:19.989335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:19.990279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 365/729] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:19.998329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:20.012373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c551-0503-4da1-b85d-0e64be42ddb8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.012686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c551-0503-4da1-b85d-0e64be42ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.012928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91c551-0503-4da1-b85d-0e64be42ddb8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.014601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 366/730] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:20.019723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838c3b-7ec4-486b-a614-d94e29f5dc50 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.020008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838c3b-7ec4-486b-a614-d94e29f5dc50 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.020285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee838c3b-7ec4-486b-a614-d94e29f5dc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.040279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ee838c3b-7ec4-486b-a614-d94e29f5dc50 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:20.041616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ee838c3b-7ec4-486b-a614-d94e29f5dc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:20.115403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 367/731] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:20.127002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:20.203143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe813-50c0-44f4-b717-13c9cda412a6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:20.253990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b4e96-68b9-43bd-974a-a1fc0a5b278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:20.254593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4e96-68b9-43bd-974a-a1fc0a5b278e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.254869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4e96-68b9-43bd-974a-a1fc0a5b278e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.255146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b4e96-68b9-43bd-974a-a1fc0a5b278e None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.255875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b4e96-68b9-43bd-974a-a1fc0a5b278e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:20.256174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b4e96-68b9-43bd-974a-a1fc0a5b278e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:20.257623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b4e96-68b9-43bd-974a-a1fc0a5b278e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:20.285773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 365/732] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 10:07:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:20.292037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee838c3b-7ec4-486b-a614-d94e29f5dc50 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:20.328986 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809f42-c3cd-4b85-aae7-4f670c1dd8c8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.329346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809f42-c3cd-4b85-aae7-4f670c1dd8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.329529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809f42-c3cd-4b85-aae7-4f670c1dd8c8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.331094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 366/733] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:20.337715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5f36-aee4-4424-8add-65e8581c9e45 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.338000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5f36-aee4-4424-8add-65e8581c9e45 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.338286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5f36-aee4-4424-8add-65e8581c9e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.365772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e34c5f36-aee4-4424-8add-65e8581c9e45 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:20.366885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e34c5f36-aee4-4424-8add-65e8581c9e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:20.419600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee838c3b-7ec4-486b-a614-d94e29f5dc50 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:20.436820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:20.452719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 367/734] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:20.453976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5f36-aee4-4424-8add-65e8581c9e45 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:20.461355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66edc54-769b-46b8-a668-0f064dacc0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:20.464326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66edc54-769b-46b8-a668-0f064dacc0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.464326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66edc54-769b-46b8-a668-0f064dacc0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.464326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66edc54-769b-46b8-a668-0f064dacc0d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.541113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66edc54-769b-46b8-a668-0f064dacc0d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:20.542899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66edc54-769b-46b8-a668-0f064dacc0d3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:20.552812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:20.655009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 368/735] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 10:07:20.660613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66edc54-769b-46b8-a668-0f064dacc0d3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:20.678743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:20.680713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5f36-aee4-4424-8add-65e8581c9e45 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:20.771096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66edc54-769b-46b8-a668-0f064dacc0d3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:20.776339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4deb-64d3-4676-b1d5-4857b0e1e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:20.776999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4deb-64d3-4676-b1d5-4857b0e1e9aa None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.777327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4deb-64d3-4676-b1d5-4857b0e1e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.777606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc4deb-64d3-4676-b1d5-4857b0e1e9aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.789936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc4deb-64d3-4676-b1d5-4857b0e1e9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-07fc4deb-64d3-4676-b1d5-4857b0e1e9aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:20.795262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:20.796235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:20.797318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:20.801320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 368/736] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:20.802336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4deb-64d3-4676-b1d5-4857b0e1e9aa None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:20.809553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:20.810188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.810467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.810742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.823117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:20.824795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:20.845964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:20.847015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:20.848586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:20.848586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:20.848586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:20.848586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 369/737] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:20.848877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:20.915363 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc4deb-64d3-4676-b1d5-4857b0e1e9aa None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:20.918172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:20.928021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:20.950138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1797a-fe73-40aa-88df-0437af87c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:20.950804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1797a-fe73-40aa-88df-0437af87c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.951084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1797a-fe73-40aa-88df-0437af87c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.951356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1797a-fe73-40aa-88df-0437af87c7b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.959388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e4967-1cd4-449d-848e-6d93f4ec7366 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:20.962593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1797a-fe73-40aa-88df-0437af87c7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e1c1797a-fe73-40aa-88df-0437af87c7b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:20.968111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:20.969215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:20.970066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:20.970790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 369/738] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:20.974346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fe057-f366-4b23-848e-a109596c191a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.974346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fe057-f366-4b23-848e-a109596c191a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.974567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fe057-f366-4b23-848e-a109596c191a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.976119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 370/739] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:20.977232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fe057-f366-4b23-848e-a109596c191a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:20.994147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:20.994758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:20.995035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:20.995306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:20.995976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:20.996276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:20.997670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.010685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 370/740] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:21.010685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.096568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fe057-f366-4b23-848e-a109596c191a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.114111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5fb0-e82f-4777-abdd-950a7401009b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.135107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17b608-89d4-4180-b657-48bd20273b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.135714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17b608-89d4-4180-b657-48bd20273b20 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.135993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17b608-89d4-4180-b657-48bd20273b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.136278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17b608-89d4-4180-b657-48bd20273b20 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.136932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17b608-89d4-4180-b657-48bd20273b20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:21.137232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17b608-89d4-4180-b657-48bd20273b20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.138845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17b608-89d4-4180-b657-48bd20273b20 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.140781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:21.150108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.150708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.150985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.151253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.151964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:21.152263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.157087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 371/741] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:21.157237 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.157320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b067-5764-466b-b2bc-08c3f46f5b15 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.157320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b067-5764-466b-b2bc-08c3f46f5b15 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.157320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b067-5764-466b-b2bc-08c3f46f5b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.166414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 371/742] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:21.168420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.176703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-80a8b067-5764-466b-b2bc-08c3f46f5b15 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:21.177893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-80a8b067-5764-466b-b2bc-08c3f46f5b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:21.205665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:21.251634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 372/743] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 10:07:21.253259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8b067-5764-466b-b2bc-08c3f46f5b15 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.276714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a10f22-96f9-4b15-88c4-62466f391eca None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.311885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.312688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.312966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.313282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.324981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.326454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:21.344791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:21.345797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:21.346697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:21.346697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:21.346697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:21.348431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 372/744] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:21.349486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.389910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8b067-5764-466b-b2bc-08c3f46f5b15 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.409868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:21.429358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.430862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.431310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.431722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.438980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.440605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:21.454399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:21.455506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:21.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:21.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:21.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:21.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:21.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:21.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:21.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:21.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:21.458411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 373/745] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:21.459577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.474948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d0b97-3035-4599-91de-39a4ce62ad19 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.489188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:21.512884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.513515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.513883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.514186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.526482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.528177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:21.543830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:21.544837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:21.545834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:21.545834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:21.545834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:21.545834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 373/746] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:21.546546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.578825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14090-8558-4fc4-95ee-3bb8c27c78f8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.613741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.614473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.614754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.615029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.615674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:21.616005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.617994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.629651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 374/747] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:21.630472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.644082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:21.652532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d7865-b787-4780-8e60-6e46c82ce4df None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.688071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.688629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.688907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.689180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.689873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:21.690174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.691600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.702987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 374/748] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:21.703753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.715128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:21.733044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a28037-4e23-488b-ade2-a7c7f6c071b8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.766454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb93637-15b7-4204-81ad-cb2174373f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.767045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93637-15b7-4204-81ad-cb2174373f25 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.767320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93637-15b7-4204-81ad-cb2174373f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.767595 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93637-15b7-4204-81ad-cb2174373f25 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.768232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb93637-15b7-4204-81ad-cb2174373f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:21.768562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb93637-15b7-4204-81ad-cb2174373f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.769913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb93637-15b7-4204-81ad-cb2174373f25 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.781974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 375/749] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:21.783138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30110928-1bad-4b35-8693-ef1a4702cc64 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.783419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30110928-1bad-4b35-8693-ef1a4702cc64 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.783690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30110928-1bad-4b35-8693-ef1a4702cc64 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.788706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 376/750] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:21.788706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30110928-1bad-4b35-8693-ef1a4702cc64 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.807144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44095fef-d1e7-44cb-aa1e-4a17fb14981a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.844458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0203590-9d6a-4da2-841f-850f2bd1d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.845070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203590-9d6a-4da2-841f-850f2bd1d99d None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.845346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203590-9d6a-4da2-841f-850f2bd1d99d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.845622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203590-9d6a-4da2-841f-850f2bd1d99d None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.846277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0203590-9d6a-4da2-841f-850f2bd1d99d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.847655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0203590-9d6a-4da2-841f-850f2bd1d99d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.887933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30110928-1bad-4b35-8693-ef1a4702cc64 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:21.918522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 375/751] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:07:21 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:21.919336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0203590-9d6a-4da2-841f-850f2bd1d99d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:21.936592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:21.940796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:21.941350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:21.941630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:21.941898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:21.951102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:21.952613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:21.955250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:21.966849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:21.967970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:21.969017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 377/752] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:21.969629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:22.040755 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0203590-9d6a-4da2-841f-850f2bd1d99d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:22.081752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc6e26-bb7f-4b5f-818c-08e585933dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:22.082359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc6e26-bb7f-4b5f-818c-08e585933dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.082641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc6e26-bb7f-4b5f-818c-08e585933dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.082912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc6e26-bb7f-4b5f-818c-08e585933dc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.083648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc6e26-bb7f-4b5f-818c-08e585933dc8 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=00dd24daa5374b85adbca9b16b807537) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:22.083951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc6e26-bb7f-4b5f-818c-08e585933dc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:22.085074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256baaa8-0775-4080-98c7-9b314a60cac3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:22.085441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc6e26-bb7f-4b5f-818c-08e585933dc8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:22.092583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 376/753] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/role_assignments?user.id=00dd24daa5374b85adbca9b16b807537&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=fe95a036fa044c4bb408b793fba6436a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:22.094861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319606-9f17-4a0c-a1d7-a39a11c98d28 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.094861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319606-9f17-4a0c-a1d7-a39a11c98d28 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.094861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319606-9f17-4a0c-a1d7-a39a11c98d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.117862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f8319606-9f17-4a0c-a1d7-a39a11c98d28 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:22.124078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f8319606-9f17-4a0c-a1d7-a39a11c98d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:22.135795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:22.136876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.137271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.137463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.150423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:22.151921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:22.169922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:22.170980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 378/754] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:07:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:22.171924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:22.231876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 377/755] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:22.237621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8319606-9f17-4a0c-a1d7-a39a11c98d28 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:22.248084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:22.256658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:22.310249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915f9b7-1388-4d9b-8467-cad44784b4d6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:22.345783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:22.346747 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.347316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.347873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.348846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:22.349357 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:22.350845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8319606-9f17-4a0c-a1d7-a39a11c98d28 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:22.351212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:22.371259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 379/756] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:07:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:22.377017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:22.400804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:22.401421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.402993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.403318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.404072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:22.404400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:22.407881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:22.441482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 378/757] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 10:07:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:22.450665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:22.559859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:22.584895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dfe21-eea7-4f43-a0d4-6c793451eafa None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:22.619319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:22.623384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ca78f-a4b6-46b4-8be8-975a7125d074 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:22.646845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:22.647531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.647836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.648084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.659800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:22.661286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:22.671583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59291200-c9f4-4748-860a-68dc07dd0afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:22.672486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59291200-c9f4-4748-860a-68dc07dd0afe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.672961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59291200-c9f4-4748-860a-68dc07dd0afe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.673445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59291200-c9f4-4748-860a-68dc07dd0afe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:22.677729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:22.683652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:22.684594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:22.684594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:22.684594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:22.684594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 380/758] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:22.684594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:22.754772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59291200-c9f4-4748-860a-68dc07dd0afe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:22.756663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59291200-c9f4-4748-860a-68dc07dd0afe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:22.785162 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e05c0-17fa-4082-a01c-7b66937e3b81 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:22.820861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:22.821711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.821992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.822265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.822916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:22.826684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:22.831518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:22.836767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:22.838065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:22.839109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:22.845446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 381/759] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 28 10:07:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:22.845446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:22.874552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:22.889195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 379/760] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 10:07:22.890328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59291200-c9f4-4748-860a-68dc07dd0afe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:22.950914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8afc42-b1ec-47cb-aa6a-77686ba37bc6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:22.986555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:22.987065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:22.987448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:22.987821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:22.988601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:22.989001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:22.990451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.000554 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59291200-c9f4-4748-860a-68dc07dd0afe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.006753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 382/761] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:23.008338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.040619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.041619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.042068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.042577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.043513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:23.043955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.045639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.056376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 380/762] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 10:07:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:23.057559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.090264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:23.107618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:23.116553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a852af-3259-4343-b9a0-26f75fea8ae4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.152486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.153305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.154099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.154484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.165958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.167490 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.173435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cefe2-70ac-423b-9bf1-fef0047fd272 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:23.183367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:23.184564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:23.185684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:23.185684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:23.185684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:23.190872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 383/763] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:23.191788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.214333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.215324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.215747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.216163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.224000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.225729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:23.238529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:23.239434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:23.240368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:23.240368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:23.240368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:23.240368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:23.240368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:23.240368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:23.240368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:23.240368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:23.246843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 381/764] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:23.247868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.299323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d8842-420e-4784-8b14-3a3b1e993bb8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.334454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.335086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.335369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.335646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.336898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:23.337198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.338565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.348429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 384/765] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:23.348429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.358108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:23.364852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:23.372677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e977e-0ed2-478e-a52a-6acdbaba39b3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.423989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.424794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.425172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.425544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.426293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:23.426693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.428213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.443631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 382/766] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:23.444610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.460724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1497341-5114-4464-ae57-6bf99d8eb8d5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.497345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.497956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.498236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.498510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.499202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:23.499548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.501116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.514602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 385/767] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:23.515448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.579316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6830-bb7a-48f5-8213-f175cf0b15fb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.587565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:23.625246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.625867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.626147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.626421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.626593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf7a5-2386-4dbd-b1c9-74b4d80baa3b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.627142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] RBAC: Adding query filter params (interface=public, service_id=4e47989643294b4f892f6c937061976f, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:23.627499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.629923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.644212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 383/768] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/endpoints?service_id=4e47989643294b4f892f6c937061976f&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:23.645457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.665442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:23.668485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.669121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.669457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.669734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.679083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.680640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:23.692630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:23.693603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:23.694504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:23.694504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:23.694504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:23.694504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:23.694504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:23.694504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:23.694504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:23.694504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:23.699385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 386/769] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:23.700322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.778927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053309ca-8dae-464b-b4f3-71a383ce99e0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.815252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e665-446f-4c71-a36d-df89a6d31a4e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:23.821556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc44f8-65e2-4e8c-822e-bff92a7f1df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.822316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc44f8-65e2-4e8c-822e-bff92a7f1df6 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.822661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc44f8-65e2-4e8c-822e-bff92a7f1df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.823027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc44f8-65e2-4e8c-822e-bff92a7f1df6 None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/7e8ce142e0c944b49053bd2a44ce4853/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.826727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc44f8-65e2-4e8c-822e-bff92a7f1df6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=7e8ce142e0c944b49053bd2a44ce4853, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.826727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc44f8-65e2-4e8c-822e-bff92a7f1df6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.854854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:23.862566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8bab5-af6a-43c0-b999-27a2077aa8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:23.863167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8bab5-af6a-43c0-b999-27a2077aa8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.863441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8bab5-af6a-43c0-b999-27a2077aa8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.863708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8bab5-af6a-43c0-b999-27a2077aa8d2 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.864394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8bab5-af6a-43c0-b999-27a2077aa8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:23.865738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8bab5-af6a-43c0-b999-27a2077aa8d2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:23.876525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 387/770] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:23.876525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8bab5-af6a-43c0-b999-27a2077aa8d2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:23.918595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 384/771] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:23 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/7e8ce142e0c944b49053bd2a44ce4853/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:23.942944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e8287-fc25-4ee1-a155-1cab71de34d8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.943406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e8287-fc25-4ee1-a155-1cab71de34d8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.943748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e8287-fc25-4ee1-a155-1cab71de34d8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:23.946111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 385/772] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:23.953599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8531-ba9d-4b1a-baa3-104244e6a991 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:23.953943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8531-ba9d-4b1a-baa3-104244e6a991 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:23.954149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8531-ba9d-4b1a-baa3-104244e6a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:24.001500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dc9f8531-ba9d-4b1a-baa3-104244e6a991 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:24.002992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dc9f8531-ba9d-4b1a-baa3-104244e6a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:24.033057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8bab5-af6a-43c0-b999-27a2077aa8d2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:24.079765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:24.080833 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:24.081373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:24.081888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:24.082884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:24.083414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:24.085484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:24.101155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 388/773] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:24.107610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:24.147789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 386/774] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:24.172083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeec2aa-b333-4cf5-9c9b-139de16d44d3 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:24.172083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeec2aa-b333-4cf5-9c9b-139de16d44d3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:24.172083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeec2aa-b333-4cf5-9c9b-139de16d44d3 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:24.172083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 387/775] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:24.177225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60593ca-1e30-475f-acec-42b44b5127f2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:24.177767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60593ca-1e30-475f-acec-42b44b5127f2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:24.177767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60593ca-1e30-475f-acec-42b44b5127f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:24.180674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:24.185402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:24.201076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c60593ca-1e30-475f-acec-42b44b5127f2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:24.202844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c60593ca-1e30-475f-acec-42b44b5127f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:24.227899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaedecd-1e65-498f-87fd-8f4a6abaea18 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:24.271269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:24.271882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:24.272160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:24.272480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:24.273293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=b3c1e3989f3242b6a9626272dea1d7ca) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:24.273696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:24.275281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:24.286530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 389/776] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:24 2022] GET /identity/v3/role_assignments?user.id=b3c1e3989f3242b6a9626272dea1d7ca&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:24.296694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 388/777] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:24.466040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:24.578955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b4d90-f7c8-4a30-8814-923141e0a195 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:24.596920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:24.616857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:24.618280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:24.618714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:24.625155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:24.625155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:24.625155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:24.625426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60593ca-1e30-475f-acec-42b44b5127f2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:24.631325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:24.632653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:24.633770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:24.636224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 390/778] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:24 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:24.642350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:24.752002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd4b58-d138-4994-ace2-00f5b6d95da2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:24.796319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:24.796319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:24.796319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:24.796319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:24.796765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] RBAC: Adding query filter params (name=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:24.796765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:24.796949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:24.809154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 391/779] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:24.814983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:24.830353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60593ca-1e30-475f-acec-42b44b5127f2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:24.893368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:24.900111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64636ef2-e858-4378-8d1e-08fa0f2ee39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:24.900859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64636ef2-e858-4378-8d1e-08fa0f2ee39d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:24.901137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64636ef2-e858-4378-8d1e-08fa0f2ee39d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:24.901406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64636ef2-e858-4378-8d1e-08fa0f2ee39d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:24.908847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:24.932898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64636ef2-e858-4378-8d1e-08fa0f2ee39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-64636ef2-e858-4378-8d1e-08fa0f2ee39d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:24.937806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:24.940464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:24.941329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 389/780] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:24.947060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64636ef2-e858-4378-8d1e-08fa0f2ee39d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:24.974955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf289f-52f6-408c-867b-ad532d252687 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:25.039669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:25.040208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:25.040519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:25.040792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:25.041430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:25.041732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:25.043099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:25.054975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 392/781] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:25.061343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:25.125398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64636ef2-e858-4378-8d1e-08fa0f2ee39d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:25.160117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:25.160980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:25.161275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:25.161550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:25.162228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:25.162537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:25.164731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:25.173759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 390/782] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:25.180809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:25.260402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cb6c2-4963-4dbd-8e55-f85cf22118a8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:25.274196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:25.300772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:25.340333 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:25.340951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:25.341233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:25.341504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:25.342219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] RBAC: Adding query filter params (interface=public, service_id=36014d5d76b648698632b33ec49b1775, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:25.342526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:25.343891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:25.346381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57e2ef-7824-4156-92e4-8181193edeed None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:25.363962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 393/783] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 10:07:25 2022] GET /identity/v3/endpoints?service_id=36014d5d76b648698632b33ec49b1775&interface=public®ion_id=RegionOne => generated 194 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:25.376339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:25.418449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:25.419139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:25.419423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:25.419701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:25.441029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:25.442531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:25.469658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:25.470669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:25.471603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:25.471603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:25.471603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:25.478134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 391/784] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:25.478977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:25.569881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bf6e4-d1e6-4153-976f-5a904aaebaba None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:25.639475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c796e97-3246-4db8-bded-d54598a56a0e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:25.660393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76300608-a52b-4c38-bbf4-69b60d84f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:25.661018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:25.661178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76300608-a52b-4c38-bbf4-69b60d84f357 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:25.661328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76300608-a52b-4c38-bbf4-69b60d84f357 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:25.661535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76300608-a52b-4c38-bbf4-69b60d84f357 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:25.662155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76300608-a52b-4c38-bbf4-69b60d84f357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:25.663805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76300608-a52b-4c38-bbf4-69b60d84f357 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:25.677190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:25.677833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:25.678107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:25.678380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:25.679035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:25.679504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:25.681136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:25.683167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 394/785] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:07:25 2022] GET /identity/v3/services => generated 772 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:25.694326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 392/786] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:25.699798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76300608-a52b-4c38-bbf4-69b60d84f357 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:25.777629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:25.884375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76300608-a52b-4c38-bbf4-69b60d84f357 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:25.920903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:25.921540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:25.923239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:25.923514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:25.931949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:25.933531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:25.948038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:25.950277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:25.952513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 395/787] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:25.960332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:26.059769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90815093-e1bb-4f78-a233-095330f2027c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:26.095370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e3ee3-8568-4622-8984-d65b11def209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:26.095907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3ee3-8568-4622-8984-d65b11def209 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.096182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3ee3-8568-4622-8984-d65b11def209 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.096483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3ee3-8568-4622-8984-d65b11def209 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.097218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e3ee3-8568-4622-8984-d65b11def209 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:26.097518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e3ee3-8568-4622-8984-d65b11def209 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:26.099024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e3ee3-8568-4622-8984-d65b11def209 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:26.119310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 393/788] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 10:07:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:26.124455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:26.252221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a6b71-ce79-43d5-9555-65ac4d34e4a5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:26.253825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:26.278598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dae37-1c61-4ea9-9070-130396a826b1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.279236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dae37-1c61-4ea9-9070-130396a826b1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.279236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dae37-1c61-4ea9-9070-130396a826b1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.280700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 394/789] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:26.287298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831154-a5e1-4229-8a43-259d9aed2510 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.287609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831154-a5e1-4229-8a43-259d9aed2510 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.288162 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81831154-a5e1-4229-8a43-259d9aed2510 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.290519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 395/790] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:26.292083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a21715-0bc1-471b-875d-c0f96827f051 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.292378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a21715-0bc1-471b-875d-c0f96827f051 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.292649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a21715-0bc1-471b-875d-c0f96827f051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.302701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a9ef7-5c42-4a51-9201-1041592d7a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:26.303337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a9ef7-5c42-4a51-9201-1041592d7a19 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.303615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a9ef7-5c42-4a51-9201-1041592d7a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.303888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a9ef7-5c42-4a51-9201-1041592d7a19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.312971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-46a21715-0bc1-471b-875d-c0f96827f051 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:26.314412 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a9ef7-5c42-4a51-9201-1041592d7a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:26.314601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-46a21715-0bc1-471b-875d-c0f96827f051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:26.315987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a9ef7-5c42-4a51-9201-1041592d7a19 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-953a9ef7-5c42-4a51-9201-1041592d7a19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:26.331683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:26.333964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:26.337012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:26.337012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:26.337012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:26.337403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:26.340354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 396/791] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:26.340354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78c44-3f1e-4d3f-bdee-b24509fdaa96 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.340354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78c44-3f1e-4d3f-bdee-b24509fdaa96 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.340354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d78c44-3f1e-4d3f-bdee-b24509fdaa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.358524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-26d78c44-3f1e-4d3f-bdee-b24509fdaa96 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:26.359773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-26d78c44-3f1e-4d3f-bdee-b24509fdaa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:26.394461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 396/792] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:26.395317 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a21715-0bc1-471b-875d-c0f96827f051 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:26.471296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 397/793] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:26.504272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a21715-0bc1-471b-875d-c0f96827f051 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:26.557034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dcb1e-0b5e-4679-a57d-c4fde797dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:26.557640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcb1e-0b5e-4679-a57d-c4fde797dc67 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.557917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcb1e-0b5e-4679-a57d-c4fde797dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.558188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcb1e-0b5e-4679-a57d-c4fde797dc67 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.558842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dcb1e-0b5e-4679-a57d-c4fde797dc67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:26.559140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dcb1e-0b5e-4679-a57d-c4fde797dc67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:26.560531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dcb1e-0b5e-4679-a57d-c4fde797dc67 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:26.580735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 397/794] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:26.586322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d78c44-3f1e-4d3f-bdee-b24509fdaa96 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:26.692284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7473974-d794-46b7-812a-f24da1eedbe5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.692626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7473974-d794-46b7-812a-f24da1eedbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.692801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7473974-d794-46b7-812a-f24da1eedbe5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.694115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 398/795] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:26.698734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:26.699914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35743d9b-f629-4c70-a47a-7f6c342402d2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.699914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35743d9b-f629-4c70-a47a-7f6c342402d2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.699914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35743d9b-f629-4c70-a47a-7f6c342402d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.720086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-35743d9b-f629-4c70-a47a-7f6c342402d2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:26.721459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-35743d9b-f629-4c70-a47a-7f6c342402d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:26.734077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:26.737234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d78c44-3f1e-4d3f-bdee-b24509fdaa96 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:26.801650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 399/796] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:26.802320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:26.802766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35743d9b-f629-4c70-a47a-7f6c342402d2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:26.802970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.803256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.803533 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.812060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:26.813727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:26.848144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:26.849326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:26.850449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 398/797] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:26.855510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:26.914415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35743d9b-f629-4c70-a47a-7f6c342402d2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:26.952800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:26.953496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:26.953868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:26.954236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:26.954947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:26.957072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:26.966912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:26.968583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:26.970246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 400/798] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 28 10:07:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:26.977403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:26.990462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:27.047514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb68ea-3cb3-47da-8076-f8d31fbe7180 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.087883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.088871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.089340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.089792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.090678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:27.091188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:27.092874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:27.102266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:27.107884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 399/799] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:27.109015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.121155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7754a-e842-43ad-bd64-13316bb7a386 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.158302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.158915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.159198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.159483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.160117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:27.160465 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:27.161918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:27.167924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 401/800] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 10:07:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:27.169274 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.218097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0b32-92d4-4d50-a555-2b3b8eee041e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.244316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:27.257158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6a6fd-53cc-44ec-b0bc-0cfe97177e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.258236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6a6fd-53cc-44ec-b0bc-0cfe97177e07 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.258661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6a6fd-53cc-44ec-b0bc-0cfe97177e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.262472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6a6fd-53cc-44ec-b0bc-0cfe97177e07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.269608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6a6fd-53cc-44ec-b0bc-0cfe97177e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-70d6a6fd-53cc-44ec-b0bc-0cfe97177e07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:27.275135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:27.276231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:27.277396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:27.278179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cdc93-d371-41ad-9289-133979387bc7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.279402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 400/801] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:27.280281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6a6fd-53cc-44ec-b0bc-0cfe97177e07 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.316221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d61b0f-10fe-40a3-aa0e-c70ba17b077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.316884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d61b0f-10fe-40a3-aa0e-c70ba17b077a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.317166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d61b0f-10fe-40a3-aa0e-c70ba17b077a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.317439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d61b0f-10fe-40a3-aa0e-c70ba17b077a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.329174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d61b0f-10fe-40a3-aa0e-c70ba17b077a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-59d61b0f-10fe-40a3-aa0e-c70ba17b077a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:27.334452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:27.335372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 402/802] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:27.337037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d61b0f-10fe-40a3-aa0e-c70ba17b077a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.347687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:27.391608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6a6fd-53cc-44ec-b0bc-0cfe97177e07 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.429454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babd475-2a01-43df-95ef-518fa76e8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.431266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babd475-2a01-43df-95ef-518fa76e8ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.431828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babd475-2a01-43df-95ef-518fa76e8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.432276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babd475-2a01-43df-95ef-518fa76e8ae3 None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/00dd24daa5374b85adbca9b16b807537/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.434506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babd475-2a01-43df-95ef-518fa76e8ae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=00dd24daa5374b85adbca9b16b807537, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:27.435931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babd475-2a01-43df-95ef-518fa76e8ae3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:27.446058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d61b0f-10fe-40a3-aa0e-c70ba17b077a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.474095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:27.479534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.480134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.480447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.480723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.481359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:27.481661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:27.483034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:27.488336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 403/803] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 28 10:07:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:27.489378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.498743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 401/804] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:27 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/00dd24daa5374b85adbca9b16b807537/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:27.499669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babd475-2a01-43df-95ef-518fa76e8ae3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.613001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f755-4e56-452f-a913-2903b8144a54 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.651173 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babd475-2a01-43df-95ef-518fa76e8ae3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.656746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.657610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.658043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.658492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.659373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:27.659827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:27.661416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:27.672152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 404/805] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:27.673289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.684698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:27.691696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.692330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.692610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.697469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.697469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:27.697469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:27.697469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:27.706219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 402/806] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:27.706912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.740741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:27.785004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3869b-c172-4944-8c9d-5a3136d8d5fa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.822165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823c36b-9250-419b-95f8-8d7896620699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.822687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c36b-9250-419b-95f8-8d7896620699 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.822971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c36b-9250-419b-95f8-8d7896620699 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.823250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c36b-9250-419b-95f8-8d7896620699 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.826809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823c36b-9250-419b-95f8-8d7896620699 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:27.826809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823c36b-9250-419b-95f8-8d7896620699 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:27.840379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbc483-8c04-43c9-8c2a-ea6a5a26deee None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:27.876439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:27.877069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:27.877449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:27.877687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:27.888469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:27.889925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:27.905831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:27.907131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:27.908065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:27.908065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:27.908065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:27.910548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 403/807] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:27.911804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.935975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 405/808] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:07:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:27.937369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823c36b-9250-419b-95f8-8d7896620699 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:27.948673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:28.045028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed88b7-c747-4f72-97a8-5f9f611f4a61 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:28.092342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823c36b-9250-419b-95f8-8d7896620699 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:28.094331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d351a5-00a2-46ee-8ab2-f2ec774c6afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:28.095243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d351a5-00a2-46ee-8ab2-f2ec774c6afe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.095510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d351a5-00a2-46ee-8ab2-f2ec774c6afe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.095784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d351a5-00a2-46ee-8ab2-f2ec774c6afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.104442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:28.109922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d351a5-00a2-46ee-8ab2-f2ec774c6afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:28.111374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d351a5-00a2-46ee-8ab2-f2ec774c6afe None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d1d351a5-00a2-46ee-8ab2-f2ec774c6afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:28.136250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:28.137284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:28.138177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:28.138177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:28.138177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:28.138357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24ee52-14c3-4c14-b069-02c4307f644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:28.138357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ee52-14c3-4c14-b069-02c4307f644e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.138357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ee52-14c3-4c14-b069-02c4307f644e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.138567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 404/809] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:28.138644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ee52-14c3-4c14-b069-02c4307f644e None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.138644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24ee52-14c3-4c14-b069-02c4307f644e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:28.139274 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24ee52-14c3-4c14-b069-02c4307f644e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:28.139372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d7f8-a635-4b55-bdc6-e5ca6dd2c94d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.139372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d7f8-a635-4b55-bdc6-e5ca6dd2c94d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.139577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d7f8-a635-4b55-bdc6-e5ca6dd2c94d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.140261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24ee52-14c3-4c14-b069-02c4307f644e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:28.145159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 405/810] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:28.146155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d7f8-a635-4b55-bdc6-e5ca6dd2c94d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:28.154223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 406/811] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:28.155535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12018e-82a6-4a6d-932d-6eb1fc1f6324 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.158794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12018e-82a6-4a6d-932d-6eb1fc1f6324 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.158794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12018e-82a6-4a6d-932d-6eb1fc1f6324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.178850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-de12018e-82a6-4a6d-932d-6eb1fc1f6324 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:28.181188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-de12018e-82a6-4a6d-932d-6eb1fc1f6324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:28.252450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:28.275591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d7f8-a635-4b55-bdc6-e5ca6dd2c94d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:28.277302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 407/812] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:28.278313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12018e-82a6-4a6d-932d-6eb1fc1f6324 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:28.366837 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:28.367969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.368260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.368566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.369223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:28.369529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:28.370899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:28.393042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:28.396550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12018e-82a6-4a6d-932d-6eb1fc1f6324 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:28.399874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 406/813] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:28.405440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:28.435255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:28.435935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.437239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.437514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.445946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:28.447404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:28.461405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:28.462534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:28.464924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 408/814] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:07:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:28.468578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:28.610143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e70119-d33e-4488-be85-8d861e0c497e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:28.648447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e271f47-e978-4356-a396-807164f4cba5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:28.651048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:28.651689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.651970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.652238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.668529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:28.670640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:28.687214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:28.688240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:28.689841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 407/815] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:07:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:28.696672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:28.697693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:28.698565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.699054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.699822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.701923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:28.702499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:28.704288 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:28.728662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 409/816] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:07:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:28.729877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:28.753911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:28.804911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c0bbb-7cbd-4819-a010-ef542f41a260 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:28.846920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:28.848054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.848532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.848956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] PATH_INFO: `/v3/services/network` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.849821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:28.851987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:28.859618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9859970-7be4-41e7-83a3-99fd9fa636f6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:28.863670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:28.864882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 10:07:28.865945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:28.868449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 408/817] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:28 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:28.869389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:28.903774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:28.904646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:28.905227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:28.905651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:28.906654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:28.907116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:28.908824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:28.928188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 410/818] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 10:07:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:28.929331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:28.946073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:28.987718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632426f8-0612-4ec5-a41a-918186740864 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.015916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:29.027422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015a5ff-e055-4a22-ae96-1cbe2823e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.028037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015a5ff-e055-4a22-ae96-1cbe2823e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.028602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015a5ff-e055-4a22-ae96-1cbe2823e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.028749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015a5ff-e055-4a22-ae96-1cbe2823e1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.041293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea530f-4f5f-443b-bdd8-7e04fcf1eef6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.079994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.080899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.081354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.081776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.082669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] RBAC: Adding query filter params (name=network) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:29.083211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.084763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.091053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 411/819] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:29.092051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.109353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015a5ff-e055-4a22-ae96-1cbe2823e1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.111100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015a5ff-e055-4a22-ae96-1cbe2823e1f9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.188938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:29.205228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be719065-1583-475d-84c4-191d7e7395dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.232531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 409/820] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:07:29.233635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015a5ff-e055-4a22-ae96-1cbe2823e1f9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.241526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.243006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.243474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.243952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.253832 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:29.256224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.258666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:29.274664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:29.282002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:29.282910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:29.282910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:29.282910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:29.282910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 412/821] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:29.282910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.349439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015a5ff-e055-4a22-ae96-1cbe2823e1f9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.388207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da22a4-5523-44ed-a130-e16ed5446e8a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.388451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.388898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.389182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.389461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.390099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] RBAC: Adding query filter params (type=network) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:29.390407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.391888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.397657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 410/822] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:29.398628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.426820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.428206 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.428734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.429829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.430449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:29.446287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.446287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:29.460235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:29.461333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:29.462245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:29.462245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:29.462245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:29.464341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 413/823] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:29.466492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.511744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f96749-651e-41a1-b330-81c8c50c433b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.516792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:29.551430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.552046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.552366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.552653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.553882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:29.554202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.555859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.573431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 411/824] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:29.574474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.579884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce00e2-4040-42b9-83ba-b15bbb298b87 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.619036 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8939a6-83c2-40ec-bbfa-b512cf1df473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.619906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8939a6-83c2-40ec-bbfa-b512cf1df473 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.620236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8939a6-83c2-40ec-bbfa-b512cf1df473 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.620548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8939a6-83c2-40ec-bbfa-b512cf1df473 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.621292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8939a6-83c2-40ec-bbfa-b512cf1df473 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.622897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8939a6-83c2-40ec-bbfa-b512cf1df473 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.662695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:29.675143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fd441-0e21-4bab-a9de-f1e2a46a66d7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.706450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 414/825] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:07:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:29.717035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b687f9d-3382-4a4b-b650-b1a6e70e747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.717402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8939a6-83c2-40ec-bbfa-b512cf1df473 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.717657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687f9d-3382-4a4b-b650-b1a6e70e747d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.717939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687f9d-3382-4a4b-b650-b1a6e70e747d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.718214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687f9d-3382-4a4b-b650-b1a6e70e747d None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.718873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b687f9d-3382-4a4b-b650-b1a6e70e747d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:29.719178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b687f9d-3382-4a4b-b650-b1a6e70e747d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.720644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b687f9d-3382-4a4b-b650-b1a6e70e747d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.741825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 412/826] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:29.744680 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711e307-64a7-475c-ae08-246f1f9fba1e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.745502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711e307-64a7-475c-ae08-246f1f9fba1e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.746068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711e307-64a7-475c-ae08-246f1f9fba1e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.749003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 413/827] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:29.750389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711e307-64a7-475c-ae08-246f1f9fba1e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.854503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:29.858255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8939a6-83c2-40ec-bbfa-b512cf1df473 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.901057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711e307-64a7-475c-ae08-246f1f9fba1e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:29.901624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681e484-8758-48a2-a99e-e621bf81e03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.901882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681e484-8758-48a2-a99e-e621bf81e03e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.902162 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681e484-8758-48a2-a99e-e621bf81e03e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.902435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681e484-8758-48a2-a99e-e621bf81e03e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.909599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681e484-8758-48a2-a99e-e621bf81e03e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.911135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681e484-8758-48a2-a99e-e621bf81e03e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e681e484-8758-48a2-a99e-e621bf81e03e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:29.926063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:29.927020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:29.927954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:29.927954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:29.927954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:29.927954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:29.927954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:29.927954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:29.927954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:29.927954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:29.929119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 415/828] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:29.930660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a9a0c-af18-417a-b9f1-52d3e82fce20 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.931494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a9a0c-af18-417a-b9f1-52d3e82fce20 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.931494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a9a0c-af18-417a-b9f1-52d3e82fce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.952404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:29.953037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:29.953243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fb6a9a0c-af18-417a-b9f1-52d3e82fce20 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:29.953345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:29.953579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:29.954428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fb6a9a0c-af18-417a-b9f1-52d3e82fce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:29.963441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:29.965355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:29.980388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:29.981321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 414/829] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:29.982785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:29.989220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:30.029196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 416/830] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:30.030030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a9a0c-af18-417a-b9f1-52d3e82fce20 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.092779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e094d-c595-4660-9f51-16a324127b1a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:30.123494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:30.128778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc9ea6-186c-4cba-afe5-8737270458f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:30.129381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc9ea6-186c-4cba-afe5-8737270458f1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.129653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc9ea6-186c-4cba-afe5-8737270458f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.129924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc9ea6-186c-4cba-afe5-8737270458f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.130611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc9ea6-186c-4cba-afe5-8737270458f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:30.130911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc9ea6-186c-4cba-afe5-8737270458f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:30.132366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc9ea6-186c-4cba-afe5-8737270458f1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:30.134022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a9a0c-af18-417a-b9f1-52d3e82fce20 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:30.150861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 415/831] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:30.150861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792890-e465-4188-876f-fd443d667e50 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.150861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792890-e465-4188-876f-fd443d667e50 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.150861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86792890-e465-4188-876f-fd443d667e50 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.150861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 416/832] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:30.151587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792890-e465-4188-876f-fd443d667e50 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.180433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3a0f5-a6de-4b92-9693-7d797f7dbd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:30.181053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3a0f5-a6de-4b92-9693-7d797f7dbd30 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.181330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3a0f5-a6de-4b92-9693-7d797f7dbd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.181606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3a0f5-a6de-4b92-9693-7d797f7dbd30 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.182305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3a0f5-a6de-4b92-9693-7d797f7dbd30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:30.182610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3a0f5-a6de-4b92-9693-7d797f7dbd30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:30.184074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3a0f5-a6de-4b92-9693-7d797f7dbd30 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:30.197014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 417/833] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:30.198181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa458-3d13-43a1-a4f9-5c233a5462b4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.198472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa458-3d13-43a1-a4f9-5c233a5462b4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.198749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa458-3d13-43a1-a4f9-5c233a5462b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.217068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-08faa458-3d13-43a1-a4f9-5c233a5462b4 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:30.218314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-08faa458-3d13-43a1-a4f9-5c233a5462b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:30.220046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:30.267324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86792890-e465-4188-876f-fd443d667e50 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:30.298713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 418/834] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:30.299693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa458-3d13-43a1-a4f9-5c233a5462b4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.311158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6903-f7eb-49f0-b890-6fb30e24853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:30.311158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6903-f7eb-49f0-b890-6fb30e24853a None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.311158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6903-f7eb-49f0-b890-6fb30e24853a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.311158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd6903-f7eb-49f0-b890-6fb30e24853a None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/b3c1e3989f3242b6a9626272dea1d7ca/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.326680 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd6903-f7eb-49f0-b890-6fb30e24853a None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=b3c1e3989f3242b6a9626272dea1d7ca, role_id=1beb7c9ed4094a7d9a1fc9e83a8c252c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:30.328627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd6903-f7eb-49f0-b890-6fb30e24853a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:30.382792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:30.401861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa458-3d13-43a1-a4f9-5c233a5462b4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:30.408611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 417/835] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:30 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/b3c1e3989f3242b6a9626272dea1d7ca/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:30.409587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6903-f7eb-49f0-b890-6fb30e24853a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.440975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:30.441827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.442210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.442583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.443411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=7e8ce142e0c944b49053bd2a44ce4853) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:30.443784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:30.445525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:30.460337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 419/836] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:30 2022] GET /identity/v3/role_assignments?user.id=7e8ce142e0c944b49053bd2a44ce4853&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=fe95a036fa044c4bb408b793fba6436a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:30.568483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.569970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd6903-f7eb-49f0-b890-6fb30e24853a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:30.587140 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:30.610951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02da0-a3b6-46b4-8d94-220f2ff03db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:30.611698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02da0-a3b6-46b4-8d94-220f2ff03db6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.612053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02da0-a3b6-46b4-8d94-220f2ff03db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.612437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02da0-a3b6-46b4-8d94-220f2ff03db6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.631199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af02da0-a3b6-46b4-8d94-220f2ff03db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8af02da0-a3b6-46b4-8d94-220f2ff03db6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:30.637720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:30.638765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:30.639820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 418/837] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:30.646158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02da0-a3b6-46b4-8d94-220f2ff03db6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.701074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93f81b-c92f-4b6c-b0cd-bf3f920e8bac None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:30.750360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:30.751270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.751696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.752112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.752932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:30.754918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:30.767004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:30.768273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:30.769188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:30.769949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 420/838] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:30.776038 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.785455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02da0-a3b6-46b4-8d94-220f2ff03db6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:30.787735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:30.824164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:30.825198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.825678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.826170 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.827035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:30.827532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:30.829134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:30.840001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 419/839] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:30.848008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.881863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:30.884859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6fabf-604b-46fc-bf7f-62f72bf1df13 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:30.924733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:30.925830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:30.927043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:30.927043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:30.927816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:30.928128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:30.929579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:30.939194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 421/840] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:30.940089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:30.961233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fcc5-8729-4e03-8062-47d6dd401718 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:31.000075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:31.001203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:31.001793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:31.002272 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:31.013326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:31.014650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:31.016341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:31.033415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:31.034453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:31.035446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:31.035446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:31.035446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:31.037667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 420/841] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:31.047550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:31.047733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451f47c-b58f-43e9-af36-dc0f9debcd30 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:31.090351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:31.091333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:31.091835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:31.092375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:31.101738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:31.101738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:31.101738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:31.103772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 422/842] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:31.156217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:31.171201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efae53-0dd2-4a93-bd33-6caa2117c7a8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:31.209754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:31.210378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:31.210722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:31.210999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:31.211665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:31.212043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:31.213561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:31.227522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 421/843] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:31.233433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:31.340322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23049d7e-c2a0-453c-a3c1-c825b5a3f772 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:31.375930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:31.376600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:31.376880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:31.377152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:31.379901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:31.385486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:31.386936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:31.398363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:31.404598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:31.405555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 423/844] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:31.406161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:31.513488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28333-f342-4ea0-9890-733377841cfd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:31.547956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:31.548652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:31.548977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:31.549259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:31.549998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:31.550304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:31.551751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:31.573740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 422/845] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 28 10:07:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:31.579473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:31.686826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faee33-d4ad-4952-a1a0-4aff6c2e22ca None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:31.721985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbfa35-da78-4e6c-9807-5e38d8331e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:31.722593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbfa35-da78-4e6c-9807-5e38d8331e88 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:31.722872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbfa35-da78-4e6c-9807-5e38d8331e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:31.723146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbfa35-da78-4e6c-9807-5e38d8331e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:31.789054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:31.795914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbfa35-da78-4e6c-9807-5e38d8331e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:31.797467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbfa35-da78-4e6c-9807-5e38d8331e88 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:31.912039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 424/846] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:07:31.918729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:31.927802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:32.025905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9c2a3-5f6d-468b-9b38-38b50a170c5d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:32.062540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:32.063233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.063518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.063793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.074960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:32.076431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:32.091249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:32.092492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:32.093633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:32.093633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:32.093633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:32.095571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 423/847] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:32.101970 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbfa35-da78-4e6c-9807-5e38d8331e88 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:32.201572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:32.207523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbfa35-da78-4e6c-9807-5e38d8331e88 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:32.244947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0438372-655b-4904-96c7-3b85a8c69982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:32.245572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438372-655b-4904-96c7-3b85a8c69982 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.245852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438372-655b-4904-96c7-3b85a8c69982 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.246123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438372-655b-4904-96c7-3b85a8c69982 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.246785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0438372-655b-4904-96c7-3b85a8c69982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:32.247085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0438372-655b-4904-96c7-3b85a8c69982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:32.248502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0438372-655b-4904-96c7-3b85a8c69982 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:32.261074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 425/848] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:32.266365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:32.340748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:32.375897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb119dc-c389-4ca2-97c5-86f37f9096e9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:32.410199 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440484b6-7382-454c-b32d-e278a95e97aa None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.410495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440484b6-7382-454c-b32d-e278a95e97aa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.410777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440484b6-7382-454c-b32d-e278a95e97aa None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.412313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:32.412481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 426/849] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:32.413601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.413977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.414256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.419141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b36ac-ef89-4727-84e7-e5d55ccb53d4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.419680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b36ac-ef89-4727-84e7-e5d55ccb53d4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.420173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b36ac-ef89-4727-84e7-e5d55ccb53d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.421574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:32.423009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:32.435632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:32.436606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:32.437542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 424/850] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:32.442541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:32.443898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-074b36ac-ef89-4727-84e7-e5d55ccb53d4 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:32.445987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-074b36ac-ef89-4727-84e7-e5d55ccb53d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:32.524395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 427/851] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:32.550459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3318a-2593-4725-9af7-ee7519289faf None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:32.568197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:32.585854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cf490-5370-4b52-a685-bea1c7bebc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:32.586486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cf490-5370-4b52-a685-bea1c7bebc51 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.586770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cf490-5370-4b52-a685-bea1c7bebc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.587043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cf490-5370-4b52-a685-bea1c7bebc51 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.587752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cf490-5370-4b52-a685-bea1c7bebc51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:32.588054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cf490-5370-4b52-a685-bea1c7bebc51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:32.589540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cf490-5370-4b52-a685-bea1c7bebc51 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:32.602952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 425/852] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:32.608897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b36ac-ef89-4727-84e7-e5d55ccb53d4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:32.633354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c94a8-09fa-4307-b375-a02eb3c14f4a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.633681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c94a8-09fa-4307-b375-a02eb3c14f4a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.633904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c94a8-09fa-4307-b375-a02eb3c14f4a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.635533 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 426/853] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:32.640613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353a0af-8892-437e-a923-a0d1ed18fff9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.640904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353a0af-8892-437e-a923-a0d1ed18fff9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.641186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353a0af-8892-437e-a923-a0d1ed18fff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.663054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1353a0af-8892-437e-a923-a0d1ed18fff9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:32.665400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1353a0af-8892-437e-a923-a0d1ed18fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:32.711618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:32.730161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b36ac-ef89-4727-84e7-e5d55ccb53d4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:32.760674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 427/854] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:32.777359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:32.778201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.778666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.779172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.780108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=00dd24daa5374b85adbca9b16b807537) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:32.780629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:32.782237 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:32.789252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 428/855] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:32 2022] GET /identity/v3/role_assignments?user.id=00dd24daa5374b85adbca9b16b807537&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=fe95a036fa044c4bb408b793fba6436a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:32.811223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353a0af-8892-437e-a923-a0d1ed18fff9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:32.935742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353a0af-8892-437e-a923-a0d1ed18fff9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:32.948531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:32.972889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361b298-5a79-4ef7-a299-6369232f69e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:32.973760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b298-5a79-4ef7-a299-6369232f69e1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:32.974041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b298-5a79-4ef7-a299-6369232f69e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:32.974316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b298-5a79-4ef7-a299-6369232f69e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:32.984667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361b298-5a79-4ef7-a299-6369232f69e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d361b298-5a79-4ef7-a299-6369232f69e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:32.989815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:32.990989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:07:32.992641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:32.995263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 428/856] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:07:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:33.001620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:33.044848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361b298-5a79-4ef7-a299-6369232f69e1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:33.131002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1c0e9-ec3f-49ee-b19d-9e553e490b1a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:33.158112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361b298-5a79-4ef7-a299-6369232f69e1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:33.177919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dc1b8-765a-4f04-8b2c-229f2a08e3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:33.178823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc1b8-765a-4f04-8b2c-229f2a08e3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.179788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc1b8-765a-4f04-8b2c-229f2a08e3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.180339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc1b8-765a-4f04-8b2c-229f2a08e3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.181172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dc1b8-765a-4f04-8b2c-229f2a08e3c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:33.182223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dc1b8-765a-4f04-8b2c-229f2a08e3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:33.184077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dc1b8-765a-4f04-8b2c-229f2a08e3c8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:33.193559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 429/857] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:07:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:33.194740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1d96a-9e9a-413e-a3e0-b64ed0415a27 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.195609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1d96a-9e9a-413e-a3e0-b64ed0415a27 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.195892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1d96a-9e9a-413e-a3e0-b64ed0415a27 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.197564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 430/858] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:33.204177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1d96a-9e9a-413e-a3e0-b64ed0415a27 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:33.205068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6d986-cdb6-4b25-af79-159b1a906cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:33.205941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d986-cdb6-4b25-af79-159b1a906cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.206226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d986-cdb6-4b25-af79-159b1a906cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.206499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6d986-cdb6-4b25-af79-159b1a906cc2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.207105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d986-cdb6-4b25-af79-159b1a906cc2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:33.208508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6d986-cdb6-4b25-af79-159b1a906cc2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:33.218241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f9e6d986-cdb6-4b25-af79-159b1a906cc2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:33.219341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:33.220280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:33.221278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 429/859] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 28 10:07:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:33.222592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6bde7-5fac-4149-ab29-08113f4ea95e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.222592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6bde7-5fac-4149-ab29-08113f4ea95e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.222934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6bde7-5fac-4149-ab29-08113f4ea95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.242807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4bd6bde7-5fac-4149-ab29-08113f4ea95e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:33.244183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4bd6bde7-5fac-4149-ab29-08113f4ea95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:33.273149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:33.317059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 430/860] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:33.317901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6bde7-5fac-4149-ab29-08113f4ea95e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:33.328720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1d96a-9e9a-413e-a3e0-b64ed0415a27 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:33.369564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:33.370626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.371150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.371645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.385746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:33.387994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:33.408466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:33.409476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:33.410390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:33.410390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:33.410390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:33.418223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 431/861] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:33.420329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:33.447024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6bde7-5fac-4149-ab29-08113f4ea95e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:33.495534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:33.496639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.497175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.497674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.498512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:33.499114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:33.500848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:33.502882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:33.507827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 431/862] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:33.516505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:33.543769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da68b13-4bb3-4a18-8525-b3cbd96cd90b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:33.550975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:33.582648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:33.583581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.583998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.584464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.585300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:33.586114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:33.587851 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:33.600232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 432/863] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:33.601997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:33.639729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229e9e-ddc6-43ea-9c45-19a4e979b98c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:33.674166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:33.674772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.675055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.675330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.675961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:33.676267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:33.677690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:33.683113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 432/864] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:33.683894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:33.729697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d08c96-c628-4ee7-98a1-a7686f2b8a55 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:33.766395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:33.781391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e5e1-23c6-48b7-9408-df6389bd834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:33.782723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e5e1-23c6-48b7-9408-df6389bd834d None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.783264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e5e1-23c6-48b7-9408-df6389bd834d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.783982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e5e1-23c6-48b7-9408-df6389bd834d None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.784898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5e5e1-23c6-48b7-9408-df6389bd834d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:33.787289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5e5e1-23c6-48b7-9408-df6389bd834d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:33.798382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:33.808548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597efd-3e40-44ce-bc6b-b1f77cfdb2ab None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:33.854171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:33.854524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:33.856853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:33.856853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:33.867172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:33.868706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:33.868962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 433/865] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:07:33 2022] POST /identity/v3/services => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:33.881450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:33.882931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:33.884065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:33.886690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 433/866] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:07:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:33.895634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e5e1-23c6-48b7-9408-df6389bd834d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:34.018960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e5e1-23c6-48b7-9408-df6389bd834d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:34.057927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:34.058543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:34.058823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:34.059098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:34.059832 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:34.060138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:34.061643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:34.084363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 434/867] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 10:07:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:34.087796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:34.196894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38497e52-9b87-4e2a-982e-bd3c98584abe None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:34.236273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e67144-7064-432b-99f2-3d5eef8ac225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:34.236911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67144-7064-432b-99f2-3d5eef8ac225 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:34.237192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67144-7064-432b-99f2-3d5eef8ac225 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:34.237462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67144-7064-432b-99f2-3d5eef8ac225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:34.258823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:34.310976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e67144-7064-432b-99f2-3d5eef8ac225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:34.312361 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e67144-7064-432b-99f2-3d5eef8ac225 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:34.420413 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 434/868] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:34 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:07:34.422395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:34.468016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:34.532708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a64f-de94-450c-9d5d-338ebf4e7d19 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:34.570843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:34.571780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:34.572265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:34.572810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:34.583852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:34.586213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:34.602515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:34.603555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:34.604490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:34.604490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:34.604490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:34.606738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 435/869] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:34.616080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e67144-7064-432b-99f2-3d5eef8ac225 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:34.667330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:34.718639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e67144-7064-432b-99f2-3d5eef8ac225 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:34.753647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84b2c4-046b-4d88-8be2-976fd23dfc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:34.754258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84b2c4-046b-4d88-8be2-976fd23dfc02 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:34.754541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84b2c4-046b-4d88-8be2-976fd23dfc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:34.754819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84b2c4-046b-4d88-8be2-976fd23dfc02 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:34.755468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84b2c4-046b-4d88-8be2-976fd23dfc02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:34.755774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84b2c4-046b-4d88-8be2-976fd23dfc02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:34.757227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84b2c4-046b-4d88-8be2-976fd23dfc02 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:34.769802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 435/870] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:34.775797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:34.855938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa074ed-389d-4b80-b162-8ff9a3baeac3 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:34.856237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa074ed-389d-4b80-b162-8ff9a3baeac3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:34.856531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa074ed-389d-4b80-b162-8ff9a3baeac3 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:34.858105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 436/871] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:34.862973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59276e38-5e74-4f06-8224-923cc2fdc2d2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:34.863245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59276e38-5e74-4f06-8224-923cc2fdc2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:34.863513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59276e38-5e74-4f06-8224-923cc2fdc2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:34.884544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-59276e38-5e74-4f06-8224-923cc2fdc2d2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:34.885528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:34.885879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-59276e38-5e74-4f06-8224-923cc2fdc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:34.895624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b0763-66fd-4b89-886e-328cfa12c0d4 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:34.937642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:34.938710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:34.939001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:34.939282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:34.948236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:34.950267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:34.965211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:34.966142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:34.967328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:34.967328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:34.967328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:34.967328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:34.967328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:34.967328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:34.967328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:34.967328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:34.971187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 436/872] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:34.972130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:34.973913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 437/873] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:35.072881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098379-c3f1-45fd-9ee2-778663ccd65d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:35.113125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:35.114146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.114627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.115097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:35.116129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:35.116683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:35.118419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:35.131800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 437/874] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:35.140158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59276e38-5e74-4f06-8224-923cc2fdc2d2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:35.186014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:35.249149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59276e38-5e74-4f06-8224-923cc2fdc2d2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:35.280145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:35.284989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:35.285600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.285889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.286164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:35.286903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=b3c1e3989f3242b6a9626272dea1d7ca) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:35.287211 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:35.289193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:35.293226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:35.296727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 438/875] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:35 2022] GET /identity/v3/role_assignments?user.id=b3c1e3989f3242b6a9626272dea1d7ca&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:35.394547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f99bf6-de1c-4e2a-93c8-4d80249381bd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:35.431884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:35.432630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.432907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.433179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:35.433787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:35.435183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:35.445470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:35.446663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:35.448868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 438/876] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:35.452521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:35.558631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc70102-2312-44f2-883c-092fb8bb1c74 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:35.562270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:35.595336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccc179-4d9c-4dbc-a3a3-83db6f3a1f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:35.595949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccc179-4d9c-4dbc-a3a3-83db6f3a1f81 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.596232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccc179-4d9c-4dbc-a3a3-83db6f3a1f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.596540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccc179-4d9c-4dbc-a3a3-83db6f3a1f81 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:35.597185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccc179-4d9c-4dbc-a3a3-83db6f3a1f81 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:35.597498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccc179-4d9c-4dbc-a3a3-83db6f3a1f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:35.598992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccc179-4d9c-4dbc-a3a3-83db6f3a1f81 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:35.605771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 439/877] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:35.611216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:35.690992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:35.708156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3da76-c7b2-4dfd-af22-1e6f73bba5b7 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.708471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3da76-c7b2-4dfd-af22-1e6f73bba5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.708757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3da76-c7b2-4dfd-af22-1e6f73bba5b7 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:35.710373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 440/878] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:35.718216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0ac4-7ffd-4042-8a73-3d9c36096788 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.718496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae318f03-8c20-40c0-b51d-5b62fb409ddc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:35.718712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0ac4-7ffd-4042-8a73-3d9c36096788 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.719111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0ac4-7ffd-4042-8a73-3d9c36096788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:35.745536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3c1e0ac4-7ffd-4042-8a73-3d9c36096788 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:35.747469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c1e0ac4-7ffd-4042-8a73-3d9c36096788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:35.763827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47af746-f590-4e61-b925-c7633d00bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:35.764730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47af746-f590-4e61-b925-c7633d00bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.765191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47af746-f590-4e61-b925-c7633d00bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.765883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47af746-f590-4e61-b925-c7633d00bbd3 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:35.767160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47af746-f590-4e61-b925-c7633d00bbd3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:35.767640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47af746-f590-4e61-b925-c7633d00bbd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:35.769688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47af746-f590-4e61-b925-c7633d00bbd3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:35.776179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 439/879] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:35.836375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 441/880] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:35.989029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d717-3fd5-46c6-9058-293f6c4a6c70 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.989329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d717-3fd5-46c6-9058-293f6c4a6c70 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.989603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d717-3fd5-46c6-9058-293f6c4a6c70 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:35.991220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 440/881] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:35.997058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c8315-bd62-42d5-b879-87d421bb9ac9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:35.997346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c8315-bd62-42d5-b879-87d421bb9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:35.997622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c8315-bd62-42d5-b879-87d421bb9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:36.019349 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bc0c8315-bd62-42d5-b879-87d421bb9ac9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:36.020870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bc0c8315-bd62-42d5-b879-87d421bb9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:36.100422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 442/882] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:36.119439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d717-3fd5-46c6-9058-293f6c4a6c70 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:36.228926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d717-3fd5-46c6-9058-293f6c4a6c70 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:36.265367 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e41767-0b43-4e05-9b8d-462f82cf1847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:36.265905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e41767-0b43-4e05-9b8d-462f82cf1847 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:36.266201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e41767-0b43-4e05-9b8d-462f82cf1847 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:36.266462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e41767-0b43-4e05-9b8d-462f82cf1847 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:36.267123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e41767-0b43-4e05-9b8d-462f82cf1847 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:36.268523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e41767-0b43-4e05-9b8d-462f82cf1847 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:36.363714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:36.371494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 441/883] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:07:36 2022] POST /identity/v3/services => generated 269 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:36.376343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c8315-bd62-42d5-b879-87d421bb9ac9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:36.408369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:36.493215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c8315-bd62-42d5-b879-87d421bb9ac9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:36.538891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:36.539949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:36.540439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:36.540884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:36.541654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:36.543265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:36.554723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:36.556159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:36.557257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:36.559470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 443/884] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:36.565756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e41767-0b43-4e05-9b8d-462f82cf1847 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:36.676471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e41767-0b43-4e05-9b8d-462f82cf1847 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:36.713446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:36.714296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:36.714718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:36.715209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:36.715987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:36.716501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:36.717998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:36.723327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 442/885] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:36.729578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:36.828438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:36.846899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2efbc3-f68b-4afa-816d-f1f7cfeebe9f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:36.883641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:36.884832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:36.885109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:36.885761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:36.886403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:36.886703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:36.888097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:36.894386 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 444/886] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:36.900579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:36.968914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:37.008651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56fb2a-6d31-45a1-a53b-b1cc9f31bc21 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:37.043744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522568d-f6cb-42a4-bd87-74c1a5d0abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:37.044376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522568d-f6cb-42a4-bd87-74c1a5d0abb1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:37.044655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522568d-f6cb-42a4-bd87-74c1a5d0abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:37.044978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522568d-f6cb-42a4-bd87-74c1a5d0abb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:37.045692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522568d-f6cb-42a4-bd87-74c1a5d0abb1 None admin] RBAC: Adding query filter params (interface=public, service_id=415156ad90094b3aa113e39e1db98235, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:37.045996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522568d-f6cb-42a4-bd87-74c1a5d0abb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:37.047356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522568d-f6cb-42a4-bd87-74c1a5d0abb1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:37.052769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 443/887] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 10:07:36 2022] GET /identity/v3/endpoints?service_id=415156ad90094b3aa113e39e1db98235&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:37.059021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:37.170161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6ab23-dfe2-47bb-9ffd-6d6311217d2d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:37.206078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c950-415a-42d7-886d-31068535c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:37.206685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c950-415a-42d7-886d-31068535c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:37.206961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c950-415a-42d7-886d-31068535c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:37.207231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c950-415a-42d7-886d-31068535c9d4 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:37.207833 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163c950-415a-42d7-886d-31068535c9d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:37.209201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163c950-415a-42d7-886d-31068535c9d4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:37.215646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 445/888] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:07:37 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:07:37.399804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a968d-c1ed-432e-bfdd-edcab41a5bb9 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:37.400207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a968d-c1ed-432e-bfdd-edcab41a5bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:37.400442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a968d-c1ed-432e-bfdd-edcab41a5bb9 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:37.401987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 444/889] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:37.407225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b47fc-03e6-460c-8cb8-07b7c7cc1798 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:37.407668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b47fc-03e6-460c-8cb8-07b7c7cc1798 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:37.407835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b47fc-03e6-460c-8cb8-07b7c7cc1798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:37.426953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a63b47fc-03e6-460c-8cb8-07b7c7cc1798 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:37.428057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a63b47fc-03e6-460c-8cb8-07b7c7cc1798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:37.440376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:37.500886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 446/890] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:37.763116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd34ed-5417-49f7-8e01-b8e21403fb17 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:37.763298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd34ed-5417-49f7-8e01-b8e21403fb17 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:37.763578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd34ed-5417-49f7-8e01-b8e21403fb17 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:37.765230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 445/891] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:37.770574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec49b-e4fb-4dcb-ac79-0b1254ea2c66 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:37.771365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd34ed-5417-49f7-8e01-b8e21403fb17 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:37.772455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec49b-e4fb-4dcb-ac79-0b1254ea2c66 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:37.772787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fec49b-e4fb-4dcb-ac79-0b1254ea2c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:37.797241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b6fec49b-e4fb-4dcb-ac79-0b1254ea2c66 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:37.799222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b6fec49b-e4fb-4dcb-ac79-0b1254ea2c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:37.883165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd34ed-5417-49f7-8e01-b8e21403fb17 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:37.897196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 447/892] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:37.915207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:37.925303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35da1d-a04c-4ea7-b025-7e8fda73ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:37.926203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35da1d-a04c-4ea7-b025-7e8fda73ec58 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:37.926645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35da1d-a04c-4ea7-b025-7e8fda73ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:37.927119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35da1d-a04c-4ea7-b025-7e8fda73ec58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:37.938764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35da1d-a04c-4ea7-b025-7e8fda73ec58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-fc35da1d-a04c-4ea7-b025-7e8fda73ec58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:37.944447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:37.945978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:37.947040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 446/893] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 10:07:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:37.951417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fec49b-e4fb-4dcb-ac79-0b1254ea2c66 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:38.031761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:38.056685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fec49b-e4fb-4dcb-ac79-0b1254ea2c66 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:38.091668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:38.092748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:38.093393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:38.093820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:38.094642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:38.095116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:38.096729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:38.106508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 448/894] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 10:07:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:38.112366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35da1d-a04c-4ea7-b025-7e8fda73ec58 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:38.176829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:38.222470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35da1d-a04c-4ea7-b025-7e8fda73ec58 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:38.264724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:38.265366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:38.265646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:38.265920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:38.277549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:38.279217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:38.294655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19f166-abca-4f53-b0e8-a7f9b031a4dc None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:38.296070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:38.298173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:38.300228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:38.300228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:38.300228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:38.303444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 447/895] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:38.303444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:38.330042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f21b-42b9-43d3-8fb2-68ae2b244301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:38.330654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f21b-42b9-43d3-8fb2-68ae2b244301 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:38.330932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f21b-42b9-43d3-8fb2-68ae2b244301 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:38.331204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9f21b-42b9-43d3-8fb2-68ae2b244301 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:38.331862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9f21b-42b9-43d3-8fb2-68ae2b244301 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:38.333293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9f21b-42b9-43d3-8fb2-68ae2b244301 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:38.349156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:38.410804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bc973-ca02-49b0-a0b6-1956c0f84396 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:38.415583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:38.428443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 449/896] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:07:38 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:38.464816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df02c71-0398-4a3f-87b2-b53b88262576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:38.465897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02c71-0398-4a3f-87b2-b53b88262576 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:38.466489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02c71-0398-4a3f-87b2-b53b88262576 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:38.466969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df02c71-0398-4a3f-87b2-b53b88262576 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:38.467857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df02c71-0398-4a3f-87b2-b53b88262576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:38.468410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df02c71-0398-4a3f-87b2-b53b88262576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:38.470249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df02c71-0398-4a3f-87b2-b53b88262576 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:38.485376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 448/897] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:38.492438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f21b-42b9-43d3-8fb2-68ae2b244301 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:38.519613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd5b31-2211-48d5-877e-3fbc5678e47d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:38.519914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd5b31-2211-48d5-877e-3fbc5678e47d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:38.520159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd5b31-2211-48d5-877e-3fbc5678e47d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:38.521849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 449/898] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:38.528017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb98a3f-4741-4d3a-9573-85f502959e44 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:38.528311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb98a3f-4741-4d3a-9573-85f502959e44 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:38.528610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb98a3f-4741-4d3a-9573-85f502959e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:38.549182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-eeb98a3f-4741-4d3a-9573-85f502959e44 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:38.550468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eeb98a3f-4741-4d3a-9573-85f502959e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:38.622379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9f21b-42b9-43d3-8fb2-68ae2b244301 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:38.636547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 450/899] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:38.665900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:38.666842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:38.667307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:38.667788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:38.676026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:38.677698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:38.689896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:38.690900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:38.691855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:38.694135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 450/900] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:07:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:38.699973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb98a3f-4741-4d3a-9573-85f502959e44 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:38.726567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:38.805054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb98a3f-4741-4d3a-9573-85f502959e44 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:38.842900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:38.843629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:38.844007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:38.844410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:38.845253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:38.845657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:38.847254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:38.865893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 451/901] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 10:07:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:38.872044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:38.935447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:38.936012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:38.986903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ae56a-fff0-4db2-b7fd-d971e5269fb3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.025164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e6b8-b9d1-424f-829d-6d610b31da50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.025924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e6b8-b9d1-424f-829d-6d610b31da50 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.026302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e6b8-b9d1-424f-829d-6d610b31da50 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.026693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e6b8-b9d1-424f-829d-6d610b31da50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.027953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:39.047491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce83b5-36fd-4407-ae9f-f86d1479e801 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.085649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.086234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.086515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.086789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.087383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.089042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:39.098642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:39.099624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:39.101265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 452/902] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 28 10:07:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:39.106987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6e6b8-b9d1-424f-829d-6d610b31da50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.107322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.108557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6e6b8-b9d1-424f-829d-6d610b31da50 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.175989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:39.231036 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044dc28-76dd-4e2f-9421-c3a771ba9ec9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.234696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 451/903] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:07:39.236349 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca232a1-d276-4f5a-9815-5a5e4c7754e4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.236843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca232a1-d276-4f5a-9815-5a5e4c7754e4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.237377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca232a1-d276-4f5a-9815-5a5e4c7754e4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.239665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 452/904] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:39.241019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca232a1-d276-4f5a-9815-5a5e4c7754e4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.266869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82b726-a719-4c11-9b6a-b7d05f035275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.267481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82b726-a719-4c11-9b6a-b7d05f035275 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.267795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82b726-a719-4c11-9b6a-b7d05f035275 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.268008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82b726-a719-4c11-9b6a-b7d05f035275 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.268666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82b726-a719-4c11-9b6a-b7d05f035275 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:39.268964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82b726-a719-4c11-9b6a-b7d05f035275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.270327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82b726-a719-4c11-9b6a-b7d05f035275 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.275409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 453/905] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:39.276548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7d64-07fe-45ac-b5d2-509a2d3056d6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.276826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7d64-07fe-45ac-b5d2-509a2d3056d6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.277095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f7d64-07fe-45ac-b5d2-509a2d3056d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.295240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dd4f7d64-07fe-45ac-b5d2-509a2d3056d6 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:39.296450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dd4f7d64-07fe-45ac-b5d2-509a2d3056d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:39.299113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:39.359614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca232a1-d276-4f5a-9815-5a5e4c7754e4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.367617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 454/906] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:39.372640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f7d64-07fe-45ac-b5d2-509a2d3056d6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.396800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.397460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.397869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.398239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.410042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.411771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:39.431920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:39.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:39.434618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:39.434618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:39.434618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:39.436534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 453/907] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:39.444480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.457176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:39.489671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f7d64-07fe-45ac-b5d2-509a2d3056d6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.526383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.527177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.527532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.527905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.528755 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:39.529158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.530640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.536326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 455/908] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:39.542359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.546162 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:39.559691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba7f5a-955f-4a86-8f21-c3c7f24cbf9c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.597144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.597738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.598020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.598295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.598948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:39.599251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.601378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.619134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 454/909] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:39.619864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.652752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc766b1-5dab-4a3b-b757-b2a4b71ead37 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.689699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.690655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.691155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.691700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.692654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] RBAC: Adding query filter params (interface=public, service_id=0d757bc03fdd4a05a1e122382ca11478, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:39.693166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.694833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.697721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:39.704335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 456/910] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/endpoints?service_id=0d757bc03fdd4a05a1e122382ca11478&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:39.704335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.729293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3327-0533-4d82-ad95-9cda352e672a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.762189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.762813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.763092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.763362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.770139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.771568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.777923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:39.783977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:39.789348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 455/911] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:39.790487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.817916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40e87a-0b47-4287-948c-38d43d6d46c3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.856689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.857316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.857591 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.857950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.858506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.859869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:39.869015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:39.870094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:39.871000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 457/912] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:39.871822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.914100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57248e-5f04-4dc6-b913-8a2da943117c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:39.943404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:39.949373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f73c40-3426-426d-871c-98662fe86f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:39.950103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f73c40-3426-426d-871c-98662fe86f2e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:39.950390 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f73c40-3426-426d-871c-98662fe86f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:39.950670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f73c40-3426-426d-871c-98662fe86f2e None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:39.951278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f73c40-3426-426d-871c-98662fe86f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:39.952685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f73c40-3426-426d-871c-98662fe86f2e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:39.958834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 456/913] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:07:39.959620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f73c40-3426-426d-871c-98662fe86f2e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:39.997402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938b627-5633-4b13-ad76-92c7a2f7a28b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:40.037222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:40.045997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:40.053229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:40.053229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:40.053229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:40.053229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:40.053229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:40.053229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:40.068822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 458/914] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:40.076015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:40.090714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f73c40-3426-426d-871c-98662fe86f2e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:40.135375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:40.135964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:40.136255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:40.136563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:40.137203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:40.137885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:40.139389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:40.145581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 457/915] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:40.151718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:40.215613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202799b-bbee-4b06-bc91-031f10083d0e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:40.222220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:40.262330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:40.263346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:40.263629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:40.264152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:40.265005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] RBAC: Adding query filter params (role.id=d6e675b96785422f9b58ee4d69294eee, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=b3c1e3989f3242b6a9626272dea1d7ca) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:40.265568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:40.267712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:40.269242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389da5c3-31b6-4ad0-b166-4463301ae89a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:40.274852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 459/916] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:40 2022] GET /identity/v3/role_assignments?user.id=b3c1e3989f3242b6a9626272dea1d7ca&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=d6e675b96785422f9b58ee4d69294eee => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:40.312454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239f84b-7215-4751-bcf1-6ea47fd39d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:40.313093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f84b-7215-4751-bcf1-6ea47fd39d3b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:40.313377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f84b-7215-4751-bcf1-6ea47fd39d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:40.313655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f84b-7215-4751-bcf1-6ea47fd39d3b None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:40.314318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239f84b-7215-4751-bcf1-6ea47fd39d3b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:40.314625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239f84b-7215-4751-bcf1-6ea47fd39d3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:40.316038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239f84b-7215-4751-bcf1-6ea47fd39d3b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:40.322246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 458/917] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 28 10:07:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:40.327972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:40.393797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:40.446456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df38f3-e282-4ca2-bc16-48c67ef4974b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:40.455931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35109027-e64a-4b87-bec7-b50853b57077 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:40.456452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35109027-e64a-4b87-bec7-b50853b57077 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:40.456645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35109027-e64a-4b87-bec7-b50853b57077 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:40.458131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 459/918] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:40.464598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399d46d-de6e-4587-9b86-67e9bff0c67d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:40.464931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399d46d-de6e-4587-9b86-67e9bff0c67d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:40.465167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399d46d-de6e-4587-9b86-67e9bff0c67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:40.484051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3eb6e-0f90-4c3d-9d12-ea28dcca0caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:40.484698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3eb6e-0f90-4c3d-9d12-ea28dcca0caa None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:40.484978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3eb6e-0f90-4c3d-9d12-ea28dcca0caa None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:40.485251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3eb6e-0f90-4c3d-9d12-ea28dcca0caa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:40.485940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3eb6e-0f90-4c3d-9d12-ea28dcca0caa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:40.487317 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b3eb6e-0f90-4c3d-9d12-ea28dcca0caa None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:40.498275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c399d46d-de6e-4587-9b86-67e9bff0c67d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:40.500330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c399d46d-de6e-4587-9b86-67e9bff0c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:40.565001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 460/919] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:07:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:40.590637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 460/920] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:40.882437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3eb6e-0f90-4c3d-9d12-ea28dcca0caa None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:41.001029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3eb6e-0f90-4c3d-9d12-ea28dcca0caa None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:41.015309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:41.037862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:41.039027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:41.039293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:41.039672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:41.040183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:41.041594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:41.050754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:41.051806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:41.052726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 461/921] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:41.061835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399d46d-de6e-4587-9b86-67e9bff0c67d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:41.115122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:41.169259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399d46d-de6e-4587-9b86-67e9bff0c67d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:41.207032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:41.207642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:41.207922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:41.208193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:41.208859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:41.209158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:41.210801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:41.216010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 461/922] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:41.221874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:41.330735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf258660-e8da-4967-812b-41ea4747939a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:41.366969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:41.367754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:41.368033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:41.368320 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:41.368974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:41.369272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:41.370654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:41.376176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 462/923] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:41.381942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:41.492544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa52d72-42e8-4360-ac4c-316e1f0cc2e4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:41.505462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:41.527457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637b935-9fff-4c11-b989-e7f53150bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:41.528065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637b935-9fff-4c11-b989-e7f53150bba9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:41.528378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637b935-9fff-4c11-b989-e7f53150bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:41.528705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637b935-9fff-4c11-b989-e7f53150bba9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:41.529418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637b935-9fff-4c11-b989-e7f53150bba9 None admin] RBAC: Adding query filter params (interface=public, service_id=8db4c2eb59644f94896ce77a464c4890, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:41.529755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637b935-9fff-4c11-b989-e7f53150bba9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:41.531121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637b935-9fff-4c11-b989-e7f53150bba9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:41.536611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 462/924] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 10:07:41 2022] GET /identity/v3/endpoints?service_id=8db4c2eb59644f94896ce77a464c4890&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:41.542618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:41.587816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:41.648957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933842-ca6d-49c0-b102-a1dfb8ce5360 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:41.683742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4e54-3788-495e-a46d-a1d6d0fd1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:41.684375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4e54-3788-495e-a46d-a1d6d0fd1224 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:41.684692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4e54-3788-495e-a46d-a1d6d0fd1224 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:41.684926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4e54-3788-495e-a46d-a1d6d0fd1224 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:41.685539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd4e54-3788-495e-a46d-a1d6d0fd1224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:41.686974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd4e54-3788-495e-a46d-a1d6d0fd1224 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:41.693416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 463/925] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:07:41 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:07:42.114358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037d09-6c34-4ca8-8b37-7d50ec7020bd None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.114358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037d09-6c34-4ca8-8b37-7d50ec7020bd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.114358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05037d09-6c34-4ca8-8b37-7d50ec7020bd None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.114358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 463/926] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:42.114748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff026cb-cbf2-40ab-98c3-be022ad26af2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.114748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff026cb-cbf2-40ab-98c3-be022ad26af2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.114748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff026cb-cbf2-40ab-98c3-be022ad26af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.127703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3ff026cb-cbf2-40ab-98c3-be022ad26af2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:42.128911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3ff026cb-cbf2-40ab-98c3-be022ad26af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:42.203466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 464/927] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:42.322072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81af2e-6cb2-4273-b11f-21f19dae590a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.322422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81af2e-6cb2-4273-b11f-21f19dae590a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.322627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81af2e-6cb2-4273-b11f-21f19dae590a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.324227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 464/928] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:42.329551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e78ab-d4e9-4c6c-ba13-d3835561ba6d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.329836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e78ab-d4e9-4c6c-ba13-d3835561ba6d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.330109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e78ab-d4e9-4c6c-ba13-d3835561ba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.348912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ae6e78ab-d4e9-4c6c-ba13-d3835561ba6d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:42.350087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae6e78ab-d4e9-4c6c-ba13-d3835561ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:42.378297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:42.419897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 465/929] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:42.480606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81af2e-6cb2-4273-b11f-21f19dae590a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:42.588418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81af2e-6cb2-4273-b11f-21f19dae590a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:42.623719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7cd74-f4a9-4abc-a67c-1f1e3125a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:42.624370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7cd74-f4a9-4abc-a67c-1f1e3125a56c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.624695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7cd74-f4a9-4abc-a67c-1f1e3125a56c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.624973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7cd74-f4a9-4abc-a67c-1f1e3125a56c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.625555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7cd74-f4a9-4abc-a67c-1f1e3125a56c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:42.626953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7cd74-f4a9-4abc-a67c-1f1e3125a56c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-65a7cd74-f4a9-4abc-a67c-1f1e3125a56c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:42.635902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:42.636917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:42.637844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 465/930] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 28 10:07:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:42.643121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e78ab-d4e9-4c6c-ba13-d3835561ba6d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:42.653273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006db3-6c5f-451a-835a-f078c803022d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.653552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006db3-6c5f-451a-835a-f078c803022d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.653825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab006db3-6c5f-451a-835a-f078c803022d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.656066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 466/931] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:42.662321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02935ac0-dc99-44d1-9c69-03b042d7ff0e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.663705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02935ac0-dc99-44d1-9c69-03b042d7ff0e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.663982 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02935ac0-dc99-44d1-9c69-03b042d7ff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.686877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-02935ac0-dc99-44d1-9c69-03b042d7ff0e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:42.688177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-02935ac0-dc99-44d1-9c69-03b042d7ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:42.725401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:42.751765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e78ab-d4e9-4c6c-ba13-d3835561ba6d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:42.761972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 467/932] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:42.763071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02935ac0-dc99-44d1-9c69-03b042d7ff0e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:42.789637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:42.790527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.791008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.791448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.792251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:42.792758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:42.794287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:42.799830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 466/933] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:42.809639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:42.858205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:42.904699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02935ac0-dc99-44d1-9c69-03b042d7ff0e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:42.948590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8556fef-9cca-46c0-85dd-250db9f1f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:42.949220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8556fef-9cca-46c0-85dd-250db9f1f523 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:42.949503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8556fef-9cca-46c0-85dd-250db9f1f523 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:42.949793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8556fef-9cca-46c0-85dd-250db9f1f523 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:42.953223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8338ea8-977f-4196-bbf1-f0a7d5612484 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:42.962514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8556fef-9cca-46c0-85dd-250db9f1f523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-a8556fef-9cca-46c0-85dd-250db9f1f523 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:42.968877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:42.969814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:42.970732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 468/934] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 10:07:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:42.976723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8556fef-9cca-46c0-85dd-250db9f1f523 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.001469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.002643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.003104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.003905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.004911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:43.005396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.007662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.019636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 467/935] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:43.020784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.021465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:43.104025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8556fef-9cca-46c0-85dd-250db9f1f523 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:43.129569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:43.138986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38be7f-f4ef-4ea0-9888-c061a8bc845b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:43.139477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.140084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.140439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.140663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.141899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:43.141899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.142967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.157328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 469/936] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 10:07:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:43.157328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.181187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44dd0b-9a0e-4eac-a92d-4ade328a6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.181805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44dd0b-9a0e-4eac-a92d-4ade328a6c29 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.182091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44dd0b-9a0e-4eac-a92d-4ade328a6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.182352 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44dd0b-9a0e-4eac-a92d-4ade328a6c29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.183025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44dd0b-9a0e-4eac-a92d-4ade328a6c29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.184433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44dd0b-9a0e-4eac-a92d-4ade328a6c29 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.250048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:43.259280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6368937-b252-4d5e-a197-d048c4b62c7f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:43.266289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 468/937] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:07:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:43.267120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44dd0b-9a0e-4eac-a92d-4ade328a6c29 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.314683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.316035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.316837 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.317417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.318946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.321201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.325667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING keystone.server.flask.common [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 10:07:43.391574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.sql.core [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 10:07:43.391574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 10:07:43.391574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [parameters: {'id': 'd8f48cf1f6b341af9f721fceedb6ccb1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 10:07:43.391574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81596) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8f48cf1f6b341af9f721fceedb6ccb1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8f48cf1f6b341af9f721fceedb6ccb1. Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application conn.query(q) Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 10:07:43.408345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result.read() Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 10:07:43.409299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application next(self.gen) Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application yield resource Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application next(self.gen) Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise self.value Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application session.commit() Aug 28 10:07:43.410313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.session.flush() Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application compat.raise_( Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 10:07:43.411258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 10:07:43.412196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application conn.query(q) Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application result.read() Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 10:07:43.416801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [parameters: {'id': 'd8f48cf1f6b341af9f721fceedb6ccb1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:43.417717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:43.418531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d8f48cf1f6b341af9f721fceedb6ccb1. Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:43.419464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 470/938] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Aug 28 10:07:43 2022] POST /identity/v3/projects => generated 262 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:43.420039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44dd0b-9a0e-4eac-a92d-4ade328a6c29 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:43.422216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.468727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.469495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.469772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.470043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.486404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.488135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.500474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:43.510838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:43.517553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:43.518458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:43.518458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:43.518458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:43.518458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 469/939] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:43.519895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.554423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e48d3-7592-4d0c-a9f9-6f166baae04e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:43.595340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.596210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.596786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.597102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.605620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.607486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:43.619741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:43.620905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:43.622023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:43.622023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:43.622023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:43.622023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:43.622023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:43.622023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:43.622023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:43.622023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:43.624014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 471/940] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:43.629364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.634331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:43.661306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637731ca-3fb3-44ca-a0f6-726def77e358 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:43.699638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2c2d-e701-444d-a794-75f731944a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.700243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2c2d-e701-444d-a794-75f731944a99 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.700551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2c2d-e701-444d-a794-75f731944a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.700819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2c2d-e701-444d-a794-75f731944a99 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.701465 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2c2d-e701-444d-a794-75f731944a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:43.701762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2c2d-e701-444d-a794-75f731944a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.703115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2c2d-e701-444d-a794-75f731944a99 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.721030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 470/941] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:43.721030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917821-ee6b-46e0-9fe3-716446f69c9f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.721030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917821-ee6b-46e0-9fe3-716446f69c9f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.721030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce917821-ee6b-46e0-9fe3-716446f69c9f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.721030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 471/942] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:43.721474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce917821-ee6b-46e0-9fe3-716446f69c9f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.742034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a880f8f-4305-4c38-8394-c5b2d0655934 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:43.782033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942622b7-3252-47ba-8784-e193864d4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.782970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942622b7-3252-47ba-8784-e193864d4d0c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.783372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942622b7-3252-47ba-8784-e193864d4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.783790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942622b7-3252-47ba-8784-e193864d4d0c None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.784492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942622b7-3252-47ba-8784-e193864d4d0c None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:43.784953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942622b7-3252-47ba-8784-e193864d4d0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.785636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:43.786969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942622b7-3252-47ba-8784-e193864d4d0c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.821484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 472/943] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:43.821484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c62de-0895-4d1b-9fd6-c222a62cfae8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.821484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c62de-0895-4d1b-9fd6-c222a62cfae8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.821484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c62de-0895-4d1b-9fd6-c222a62cfae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.828624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce917821-ee6b-46e0-9fe3-716446f69c9f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:43.852903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3c9c62de-0895-4d1b-9fd6-c222a62cfae8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:43.854617 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c9c62de-0895-4d1b-9fd6-c222a62cfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:43.871991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:43.872772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:43.873053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:43.873328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:43.881761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:43.883346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:43.899148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:43.900189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:43.901684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:43.905027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 472/944] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:07:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:43.905980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:43.948835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:43.968267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 473/945] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:44.036074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd752-59a7-4ea6-bffa-09932b5b3f7a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:44.060231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:44.075147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:44.075765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:44.076038 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:44.076352 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:44.077071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:44.077396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:44.078873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:44.097846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 473/946] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 10:07:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:44.104114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c62de-0895-4d1b-9fd6-c222a62cfae8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.207999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c62de-0895-4d1b-9fd6-c222a62cfae8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:44.237879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.245394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:44.246035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:44.246320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:44.246593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:44.257705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:44.259206 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:44.274801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:44.275976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:44.277090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:44.277090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:44.277090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:44.277090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 474/947] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:44.281862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.333766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:44.374746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e4771-21f1-4df2-8f5a-b5bd82725391 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:44.393704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85cdc0-5542-4a11-a1e7-556c964d8155 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:44.427210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:44.428410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:44.429380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:44.429802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:44.430651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:44.432132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:44.432412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:44.432945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:44.433249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:44.433507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:44.434154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:44.434509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:44.435854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:44.445149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:44.446394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:44.447468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:44.450748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 474/948] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:44.452026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 475/949] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:44.456704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.461387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.510939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:44.583253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef00c3a-2365-4027-b873-2735c22bf6a3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:44.595608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28eb41d-ae83-4beb-bb36-b01ff86b0ff4 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:44.606706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:44.625906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:44.626567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:44.627051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:44.627606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:44.627885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:44.628185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:44.630127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:44.641588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 475/950] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:44.643823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.653457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:44.654218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:44.654593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:44.654960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:44.662193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:44.664916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:44.676813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:44.678101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:44.680025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:44.680025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:44.680025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:44.680025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:44.680025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:44.680025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:44.680025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:44.680025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:44.681421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 476/951] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:44.686700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.775698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4d108-15bd-4d22-a587-9e0817887f73 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:44.784508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:44.813498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bbc00-3efa-4355-b9e3-bf9429d69adf None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:44.822328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:44.822973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:44.823302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:44.823639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:44.824318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:44.825047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:44.826248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:44.837042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 476/952] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:44.839080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.862951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:44.863701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:44.864103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:44.864447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:44.865174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:44.865481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:44.867972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:44.891992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 477/953] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:44.893056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:44.927504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:44.965965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b68e56-f3c3-4318-80a4-90822852f10a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:45.003092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe6e69-6b05-43a0-b172-80573b0cd487 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:45.004334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20270bec-3a58-4633-b8d3-4aae86d9f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:45.004875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20270bec-3a58-4633-b8d3-4aae86d9f14a None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:45.005161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20270bec-3a58-4633-b8d3-4aae86d9f14a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:45.005432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20270bec-3a58-4633-b8d3-4aae86d9f14a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:45.006234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20270bec-3a58-4633-b8d3-4aae86d9f14a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:45.008266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20270bec-3a58-4633-b8d3-4aae86d9f14a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:45.042580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0ba5-a0e9-4d7b-98fc-609ede9b9551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:45.043161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0ba5-a0e9-4d7b-98fc-609ede9b9551 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:45.043446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0ba5-a0e9-4d7b-98fc-609ede9b9551 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:45.043722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0ba5-a0e9-4d7b-98fc-609ede9b9551 None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/b3c1e3989f3242b6a9626272dea1d7ca/roles/d6e675b96785422f9b58ee4d69294eee` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:45.045945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a0ba5-a0e9-4d7b-98fc-609ede9b9551 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=b3c1e3989f3242b6a9626272dea1d7ca, role_id=d6e675b96785422f9b58ee4d69294eee)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:45.047370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a0ba5-a0e9-4d7b-98fc-609ede9b9551 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:45.095154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 477/954] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:07:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:07:45.129718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 478/955] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:07:44 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/b3c1e3989f3242b6a9626272dea1d7ca/roles/d6e675b96785422f9b58ee4d69294eee => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:07:45.282700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc911560-d613-4a70-9e1c-dc2a8384e947 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:45.283239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc911560-d613-4a70-9e1c-dc2a8384e947 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:45.283239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc911560-d613-4a70-9e1c-dc2a8384e947 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:45.284606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 478/956] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:45.291025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99487-757e-44ad-a0da-cee71cb24aae None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:45.291308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99487-757e-44ad-a0da-cee71cb24aae None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:45.291582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b99487-757e-44ad-a0da-cee71cb24aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:45.311717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-49b99487-757e-44ad-a0da-cee71cb24aae None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:45.312859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-49b99487-757e-44ad-a0da-cee71cb24aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:45.396937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 479/957] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:45.667017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc911560-d613-4a70-9e1c-dc2a8384e947 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:45.696893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:45.775334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc911560-d613-4a70-9e1c-dc2a8384e947 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:45.813014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14dbb5-9df0-43c3-8f34-0a712b03c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:45.813650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14dbb5-9df0-43c3-8f34-0a712b03c980 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:45.813939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14dbb5-9df0-43c3-8f34-0a712b03c980 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:45.814213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14dbb5-9df0-43c3-8f34-0a712b03c980 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:45.814812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14dbb5-9df0-43c3-8f34-0a712b03c980 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:45.816194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14dbb5-9df0-43c3-8f34-0a712b03c980 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-ad14dbb5-9df0-43c3-8f34-0a712b03c980 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:45.831749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:45.833049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:45.834532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 479/958] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:45.841411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b99487-757e-44ad-a0da-cee71cb24aae None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:45.857268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:45.947765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b99487-757e-44ad-a0da-cee71cb24aae None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:45.983890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:45.984529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:45.984815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:45.985090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:45.985729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:45.986033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:45.987397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:45.989818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb57f0-fed4-4329-b92c-fdcfd6de5537 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:45.990100 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb57f0-fed4-4329-b92c-fdcfd6de5537 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:45.990372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb57f0-fed4-4329-b92c-fdcfd6de5537 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:45.992398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 480/959] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:45.996943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 480/960] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:45.997527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11386a-aac7-4e2c-887b-e60bc327e143 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:45.997954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11386a-aac7-4e2c-887b-e60bc327e143 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:45.998295 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11386a-aac7-4e2c-887b-e60bc327e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:46.005268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:46.017821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2a11386a-aac7-4e2c-887b-e60bc327e143 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:46.019187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2a11386a-aac7-4e2c-887b-e60bc327e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:46.095443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:46.107441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 481/961] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:46.122687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaa144-3457-459c-b2a7-b94c999b3a51 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:46.158367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:46.159308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:46.159749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:46.160239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:46.161063 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] RBAC: Adding query filter params (type=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:46.161542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:46.163905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:46.169350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 481/962] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:46.390824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11386a-aac7-4e2c-887b-e60bc327e143 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:46.414633 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:46.498485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11386a-aac7-4e2c-887b-e60bc327e143 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:46.535808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:46.536513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:46.536791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:46.537057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:46.538027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:46.539798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:46.542328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING keystone.server.flask.common [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 10:07:46.585336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.sql.core [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 10:07:46.585336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 10:07:46.585336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [parameters: {'user_id': '4af460f5452a4885b6c7557cff1e297f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 10:07:46.585336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81597) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Aug 28 10:07:46.592048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 10:07:46.592995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application yield resource Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application next(self.gen) Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise self.value Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application session.commit() Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 10:07:46.594346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.session.flush() Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application compat.raise_( Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 10:07:46.596213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 10:07:46.598263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application conn.query(q) Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application result.read() Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 10:07:46.600542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [parameters: {'user_id': '4af460f5452a4885b6c7557cff1e297f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:46.602840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 28 10:07:46.605073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 28 10:07:46.608373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 28 10:07:46.608373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 28 10:07:46.608373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 10:07:46.608373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 10:07:46.608373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 10:07:46.608373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:46.608373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 482/963] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 28 10:07:46 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:46.609502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:46.711088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fafed-e9b6-451b-adee-9757c367cdab None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:46.746328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6299d-30b5-42af-9125-40258df96918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:46.746955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6299d-30b5-42af-9125-40258df96918 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:46.747236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6299d-30b5-42af-9125-40258df96918 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:46.747506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6299d-30b5-42af-9125-40258df96918 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:46.755299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6299d-30b5-42af-9125-40258df96918 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:46.757297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6299d-30b5-42af-9125-40258df96918 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:46.759925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-22f6299d-30b5-42af-9125-40258df96918 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:46.769147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:46.771025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:46.778905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 482/964] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:46.780487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:46.864788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:46.883651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389a3d-1000-4b5c-9d39-8d9175eaf810 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:46.919989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b26494-328c-4fc3-ae2c-ac1b74c24bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:46.920923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26494-328c-4fc3-ae2c-ac1b74c24bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:46.921392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26494-328c-4fc3-ae2c-ac1b74c24bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:46.921842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b26494-328c-4fc3-ae2c-ac1b74c24bf5 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:46.922730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26494-328c-4fc3-ae2c-ac1b74c24bf5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:46.923185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26494-328c-4fc3-ae2c-ac1b74c24bf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:46.924992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b26494-328c-4fc3-ae2c-ac1b74c24bf5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:46.967432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 483/965] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 28 10:07:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:47.157845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97025b7-5069-4121-a6b4-a9706d43415b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:47.158355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97025b7-5069-4121-a6b4-a9706d43415b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:47.158355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97025b7-5069-4121-a6b4-a9706d43415b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:47.159847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 483/966] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:47.166151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6144d-5e9f-495b-afab-2c4abba15665 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:47.166723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6144d-5e9f-495b-afab-2c4abba15665 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:47.167241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6144d-5e9f-495b-afab-2c4abba15665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:47.187157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-dcc6144d-5e9f-495b-afab-2c4abba15665 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:47.189186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dcc6144d-5e9f-495b-afab-2c4abba15665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:47.265756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 484/967] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:47.278620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed612d5-fc11-4fb1-bbd5-08bb94af327a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:47.278907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed612d5-fc11-4fb1-bbd5-08bb94af327a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:47.279182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed612d5-fc11-4fb1-bbd5-08bb94af327a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:47.280672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 484/968] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:47.285665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dada0a-0e42-449d-b0b7-37c2b7120186 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:47.285957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dada0a-0e42-449d-b0b7-37c2b7120186 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:47.286236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dada0a-0e42-449d-b0b7-37c2b7120186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:47.305003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-79dada0a-0e42-449d-b0b7-37c2b7120186 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:47.306181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-79dada0a-0e42-449d-b0b7-37c2b7120186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:47.369607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:47.374637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 485/969] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:47.539353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed612d5-fc11-4fb1-bbd5-08bb94af327a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:47.646139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed612d5-fc11-4fb1-bbd5-08bb94af327a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:47.648008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dada0a-0e42-449d-b0b7-37c2b7120186 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:47.684037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:47.685084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:47.685368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:47.685641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:47.686236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:47.687634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:47.696808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:47.697872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:47.698751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 485/970] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:47.704273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:47.757260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dada0a-0e42-449d-b0b7-37c2b7120186 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:47.774085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:47.794845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe86e6-9637-4ba0-af1f-4d035f3b44b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:47.795391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe86e6-9637-4ba0-af1f-4d035f3b44b0 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:47.795716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe86e6-9637-4ba0-af1f-4d035f3b44b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:47.795986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe86e6-9637-4ba0-af1f-4d035f3b44b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:47.809439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe86e6-9637-4ba0-af1f-4d035f3b44b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:47.814484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193e07e-3934-4e25-8bcc-9cfdc0c41767 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-83fe86e6-9637-4ba0-af1f-4d035f3b44b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:47.815677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:47.816935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:07:47.817806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:47.818521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 486/971] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 10:07:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:47.824538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe86e6-9637-4ba0-af1f-4d035f3b44b0 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:47.862044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:47.862909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:47.863191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:47.864359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:47.865009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:47.865317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:47.866894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:47.873356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 486/972] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:47.878579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:47.894065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:47.937545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe86e6-9637-4ba0-af1f-4d035f3b44b0 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:47.977674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:47.978549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:47.978926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:47.979266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:47.980006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:47.980503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:47.982080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:47.983867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631988f-9e7f-4386-ada4-b694f499dae6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:47.991590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 487/973] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 10:07:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:47.997295 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:48.013643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:48.023521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.024506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.025210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.026249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.027174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:48.027555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.029738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:48.036536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 487/974] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:48.043270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:48.111604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90046951-3812-4103-81ab-49bd9df7a612 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:48.134327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:48.145807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bda66-55cf-438b-bc98-dbc9c16db4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.146036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d7b1-92b3-4bbe-b2d4-1d94e7e69c8e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:48.146437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bda66-55cf-438b-bc98-dbc9c16db4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.146708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bda66-55cf-438b-bc98-dbc9c16db4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.146977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bda66-55cf-438b-bc98-dbc9c16db4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.158285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bda66-55cf-438b-bc98-dbc9c16db4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.159734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bda66-55cf-438b-bc98-dbc9c16db4d5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b03bda66-55cf-438b-bc98-dbc9c16db4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:48.175115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:48.176200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:48.177182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:48.177182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:48.177182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:48.177182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 488/975] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:48.177647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f7961-bc16-4d92-90a0-36826d09a88a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.177997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f7961-bc16-4d92-90a0-36826d09a88a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.178200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f7961-bc16-4d92-90a0-36826d09a88a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.179598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 489/976] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:48.183204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e6f49-cd2c-4cd0-8c37-1779312b02de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.183816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6f49-cd2c-4cd0-8c37-1779312b02de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.184096 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6f49-cd2c-4cd0-8c37-1779312b02de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.184378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f7961-bc16-4d92-90a0-36826d09a88a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:48.184491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e6f49-cd2c-4cd0-8c37-1779312b02de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.185114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e6f49-cd2c-4cd0-8c37-1779312b02de None admin] RBAC: Adding query filter params (interface=admin, service_id=8db4c2eb59644f94896ce77a464c4890, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:48.185425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e6f49-cd2c-4cd0-8c37-1779312b02de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.186800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e6f49-cd2c-4cd0-8c37-1779312b02de None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:48.191865 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 488/977] 10.222.0.27 () {56 vars in 1249 bytes} [Sun Aug 28 10:07:48 2022] GET /identity/v3/endpoints?service_id=8db4c2eb59644f94896ce77a464c4890&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:48.193021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449a50-e23d-40c5-8ce0-2f513968a978 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.193303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449a50-e23d-40c5-8ce0-2f513968a978 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.193578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449a50-e23d-40c5-8ce0-2f513968a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.211331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-cf449a50-e23d-40c5-8ce0-2f513968a978 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:48.212537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cf449a50-e23d-40c5-8ce0-2f513968a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:48.262119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:48.279209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 489/978] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:48.280238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449a50-e23d-40c5-8ce0-2f513968a978 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:48.291953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f7961-bc16-4d92-90a0-36826d09a88a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:48.328723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.329325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.329609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.329878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.330519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:48.330820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.332190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:48.345407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 490/979] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:48.350742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:48.386431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:48.390675 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449a50-e23d-40c5-8ce0-2f513968a978 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:48.425505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a45c5-70f2-4f24-a0a6-41fdb71fc9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.426297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a45c5-70f2-4f24-a0a6-41fdb71fc9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.426578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a45c5-70f2-4f24-a0a6-41fdb71fc9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.426848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a45c5-70f2-4f24-a0a6-41fdb71fc9d6 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.427462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a45c5-70f2-4f24-a0a6-41fdb71fc9d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.429213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a45c5-70f2-4f24-a0a6-41fdb71fc9d6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:48.435231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 490/980] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:07:48 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:07:48.463663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eb088-6f1f-45bf-b844-921ab9dd4e44 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:48.503171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.503811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.504087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.504381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.513090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.514579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:48.527893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:48.529024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 10:07:48.530520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:48.532661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 491/981] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:07:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:48.534875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a45c5-70f2-4f24-a0a6-41fdb71fc9d6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:48.552927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:48.597393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:48.649688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a45c5-70f2-4f24-a0a6-41fdb71fc9d6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:48.658970 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:48.666708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645d77d-67fe-449b-9b3d-b73e7321f80e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:48.690225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.690836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.691117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.691434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.692312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:48.692435 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.693860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:48.703192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c27a-45bd-45cb-a80d-a946d4ae7b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.703795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c27a-45bd-45cb-a80d-a946d4ae7b80 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.704075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c27a-45bd-45cb-a80d-a946d4ae7b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.704362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695c27a-45bd-45cb-a80d-a946d4ae7b80 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.705030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c27a-45bd-45cb-a80d-a946d4ae7b80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.706388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695c27a-45bd-45cb-a80d-a946d4ae7b80 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:48.712800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 491/982] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 28 10:07:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:48.718428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:48.776530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 492/983] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:07:48 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:07:48.840498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a03e99-32fa-4bc2-bb15-60787589802a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:48.852992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:48.890839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09497645-8845-475f-9aa6-b4b0301c1973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:48.891473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497645-8845-475f-9aa6-b4b0301c1973 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:48.891759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497645-8845-475f-9aa6-b4b0301c1973 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:48.892036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497645-8845-475f-9aa6-b4b0301c1973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:48.966980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09497645-8845-475f-9aa6-b4b0301c1973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:48.968402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09497645-8845-475f-9aa6-b4b0301c1973 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:49.075677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 492/984] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:48 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 10:07:49.077328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c27a-45bd-45cb-a80d-a946d4ae7b80 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:49.182280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695c27a-45bd-45cb-a80d-a946d4ae7b80 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:49.215298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:49.215936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:49.216217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:49.216523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:49.227622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:49.229046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:49.244985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:49.245978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:49.246918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:49.246918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:49.246918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:49.246918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 493/985] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:49.250484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09497645-8845-475f-9aa6-b4b0301c1973 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:49.253949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:49.352329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09497645-8845-475f-9aa6-b4b0301c1973 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:49.386629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:49.387523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:49.388009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:49.388556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:49.389447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:49.389954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:49.391508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:49.404336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 493/986] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:49.409723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:49.420208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:49.515870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362214a2-c566-4071-81b2-7b2f3a46858e None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:49.551637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:49.552266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:49.552571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:49.552847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:49.560184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:49.561659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:49.574093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:49.575113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:49.576050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:49.576050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:49.576050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:49.576050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:49.576050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:49.576050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:49.576050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:49.576050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:49.579984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 494/987] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:49.581394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:49.646296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:49.685637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e348c-873f-4eb9-816c-87825c318f3b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:49.718861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aad85b-be03-4a73-9aff-f49e23b06390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:49.719465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad85b-be03-4a73-9aff-f49e23b06390 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:49.719747 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad85b-be03-4a73-9aff-f49e23b06390 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:49.720022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad85b-be03-4a73-9aff-f49e23b06390 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:49.720741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aad85b-be03-4a73-9aff-f49e23b06390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:49.721051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aad85b-be03-4a73-9aff-f49e23b06390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:49.722474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aad85b-be03-4a73-9aff-f49e23b06390 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:49.734491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 494/988] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:49.740423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:49.808260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:49.853177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f3a8c-9df0-4af5-a842-eb2fcadd5a32 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:49.889225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54639f-d069-45ef-b3a1-c98d31f283f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:49.889833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54639f-d069-45ef-b3a1-c98d31f283f8 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:49.890114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54639f-d069-45ef-b3a1-c98d31f283f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:49.890389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54639f-d069-45ef-b3a1-c98d31f283f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:49.891127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54639f-d069-45ef-b3a1-c98d31f283f8 None admin] RBAC: Adding query filter params (role.id=d6e675b96785422f9b58ee4d69294eee, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=b3c1e3989f3242b6a9626272dea1d7ca) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:49.891435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54639f-d069-45ef-b3a1-c98d31f283f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:49.892905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54639f-d069-45ef-b3a1-c98d31f283f8 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:49.904669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 495/989] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:49 2022] GET /identity/v3/role_assignments?user.id=b3c1e3989f3242b6a9626272dea1d7ca&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=d6e675b96785422f9b58ee4d69294eee => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:50.387427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52478-3e60-40b0-b893-c0be2ba26f50 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:50.387964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52478-3e60-40b0-b893-c0be2ba26f50 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:50.387964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52478-3e60-40b0-b893-c0be2ba26f50 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:50.389470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 495/990] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:50.394442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e271144-3cdf-4f23-9830-0c6edb32fe62 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:50.394728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e271144-3cdf-4f23-9830-0c6edb32fe62 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:50.395001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e271144-3cdf-4f23-9830-0c6edb32fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:50.414736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1e271144-3cdf-4f23-9830-0c6edb32fe62 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:50.415921 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e271144-3cdf-4f23-9830-0c6edb32fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:50.483405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 496/991] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:50.722587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42fd2-a3e0-419f-bede-50199cc10937 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:50.722935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42fd2-a3e0-419f-bede-50199cc10937 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:50.723049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42fd2-a3e0-419f-bede-50199cc10937 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:50.724549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 496/992] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:50.729663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54e3e-5a70-4418-866d-472dc008cc75 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:50.729961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54e3e-5a70-4418-866d-472dc008cc75 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:50.730244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54e3e-5a70-4418-866d-472dc008cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:50.747972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4af54e3e-5a70-4418-866d-472dc008cc75 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:50.749199 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4af54e3e-5a70-4418-866d-472dc008cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:50.753727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42fd2-a3e0-419f-bede-50199cc10937 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:50.814523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:50.826878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 497/993] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:50.868436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42fd2-a3e0-419f-bede-50199cc10937 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:50.892604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:50.903494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:50.904126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:50.904433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:50.907136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:50.907136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:50.907136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:50.915960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:50.917205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 10:07:50.918061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:50.925504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 497/994] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 28 10:07:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:50.926682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54e3e-5a70-4418-866d-472dc008cc75 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:51.031708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54e3e-5a70-4418-866d-472dc008cc75 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:51.071211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:51.071922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.072272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.072643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.073379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:51.073749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:51.075260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:51.086602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 498/995] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:51.086743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:51.101798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:51.177605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:51.206937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa62341-a523-4521-891c-f9187fe643a5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:51.235357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdad73-c8d4-4878-8cb6-3e16226f5249 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:51.252228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:51.253219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.254045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.254324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.255264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:51.255579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:51.257788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:51.264052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 498/996] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 28 10:07:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:51.269535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:51.277143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:51.278018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.278457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.278872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.279611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:51.281018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:51.291364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:51.292396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:51.298260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 499/997] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:51.299087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:51.337270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:51.410338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64963d-2024-414b-8fb0-086aa9482b39 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:51.418342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b464a-6dc3-4da1-87f3-4cfe4a9a2e68 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:51.440666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:51.455483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826fe88-dc5a-4cd0-a78a-f0127b929578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:51.457270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826fe88-dc5a-4cd0-a78a-f0127b929578 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.458121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826fe88-dc5a-4cd0-a78a-f0127b929578 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.458582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826fe88-dc5a-4cd0-a78a-f0127b929578 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.459931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826fe88-dc5a-4cd0-a78a-f0127b929578 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:51.461941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826fe88-dc5a-4cd0-a78a-f0127b929578 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:51.464569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:51.465615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.466346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.467085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.467743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] RBAC: Adding query filter params (name=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:51.468047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:51.469798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:51.483624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 500/998] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:51.485038 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:51.536325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 499/999] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:07:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:51.601570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f51e2-8c72-4a91-bc35-8aa37cdb5ade None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:51.645479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:51.646102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.646380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.646654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.647354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:51.647847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:51.649295 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:51.659728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 501/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:51.660974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826fe88-dc5a-4cd0-a78a-f0127b929578 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:51.766900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826fe88-dc5a-4cd0-a78a-f0127b929578 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:51.780951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:51.802711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60baedc-1592-4fa6-b65a-77fa937dd8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:51.803421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60baedc-1592-4fa6-b65a-77fa937dd8de None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.803912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60baedc-1592-4fa6-b65a-77fa937dd8de None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.806625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60baedc-1592-4fa6-b65a-77fa937dd8de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.806625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60baedc-1592-4fa6-b65a-77fa937dd8de None admin] RBAC: Adding query filter params (interface=public, service_id=cfdf50ae79fc49ea9e98f74f8cf97910, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:51.806625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60baedc-1592-4fa6-b65a-77fa937dd8de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:51.806857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60baedc-1592-4fa6-b65a-77fa937dd8de None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:51.812105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 500/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 10:07:51 2022] GET /identity/v3/endpoints?service_id=cfdf50ae79fc49ea9e98f74f8cf97910&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:51.817716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:51.856503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be265e-3cb7-42a0-bfb6-f9744f7bd89e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.857144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be265e-3cb7-42a0-bfb6-f9744f7bd89e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.857914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be265e-3cb7-42a0-bfb6-f9744f7bd89e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.860946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 501/1002] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:51.864791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374eed-5c24-482e-b3eb-e53697edd069 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.865077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374eed-5c24-482e-b3eb-e53697edd069 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.865353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32374eed-5c24-482e-b3eb-e53697edd069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.870376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:51.885621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-32374eed-5c24-482e-b3eb-e53697edd069 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:51.886789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-32374eed-5c24-482e-b3eb-e53697edd069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:51.930017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42782cf0-6020-4fa1-be9e-484b703c3eb9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:51.960010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 502/1003] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:51.966895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90657a8-a933-4ef8-8ae7-3b2bea6d1ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:51.967509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90657a8-a933-4ef8-8ae7-3b2bea6d1ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:51.967783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90657a8-a933-4ef8-8ae7-3b2bea6d1ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:51.968056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90657a8-a933-4ef8-8ae7-3b2bea6d1ef5 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:51.968693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90657a8-a933-4ef8-8ae7-3b2bea6d1ef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:51.970058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90657a8-a933-4ef8-8ae7-3b2bea6d1ef5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:51.984578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 502/1004] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:07:51 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:07:52.231914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374eed-5c24-482e-b3eb-e53697edd069 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:52.332720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32374eed-5c24-482e-b3eb-e53697edd069 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:52.340281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:52.367095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:52.367801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:52.368080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:52.368378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] PATH_INFO: `/v3/services/image` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:52.368990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:52.370340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:52.379472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:52.380734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:52.381725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 503/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 28 10:07:52 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:52.386667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90657a8-a933-4ef8-8ae7-3b2bea6d1ef5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:52.493378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90657a8-a933-4ef8-8ae7-3b2bea6d1ef5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:52.500490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:52.528429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67400fb5-52b3-4340-81ad-dbd9c210833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:52.529034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400fb5-52b3-4340-81ad-dbd9c210833b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:52.529312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400fb5-52b3-4340-81ad-dbd9c210833b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:52.529582 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400fb5-52b3-4340-81ad-dbd9c210833b None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:52.530216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67400fb5-52b3-4340-81ad-dbd9c210833b None admin] RBAC: Adding query filter params (name=image) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:52.530514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67400fb5-52b3-4340-81ad-dbd9c210833b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:52.531938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67400fb5-52b3-4340-81ad-dbd9c210833b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:52.542777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 503/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:52.544520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:52.648024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339e6d-827d-4571-af14-d587081b3c46 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:52.682151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d71bd9-cbd7-4979-9cb8-d3da44acbfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:52.682748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71bd9-cbd7-4979-9cb8-d3da44acbfbb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:52.683031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71bd9-cbd7-4979-9cb8-d3da44acbfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:52.683306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71bd9-cbd7-4979-9cb8-d3da44acbfbb None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:52.683943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d71bd9-cbd7-4979-9cb8-d3da44acbfbb None admin] RBAC: Adding query filter params (type=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:52.684250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d71bd9-cbd7-4979-9cb8-d3da44acbfbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:52.685639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d71bd9-cbd7-4979-9cb8-d3da44acbfbb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:52.690191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 504/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:53.481559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf8be-9e03-49a8-84c3-d10c5580cd93 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:53.482083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf8be-9e03-49a8-84c3-d10c5580cd93 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:53.482194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccf8be-9e03-49a8-84c3-d10c5580cd93 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:53.483495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 504/1008] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:53.488694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fedc9-bfc5-4d37-ae55-3bacf4a6b475 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:53.489047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fedc9-bfc5-4d37-ae55-3bacf4a6b475 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:53.489392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fedc9-bfc5-4d37-ae55-3bacf4a6b475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:53.508327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-286fedc9-bfc5-4d37-ae55-3bacf4a6b475 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:53.509534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-286fedc9-bfc5-4d37-ae55-3bacf4a6b475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:53.538025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:53.580336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 505/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:53.849065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccf8be-9e03-49a8-84c3-d10c5580cd93 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:53.889099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044b428-513b-4016-bdc5-9059e3cfbaec None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:53.890980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044b428-513b-4016-bdc5-9059e3cfbaec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:53.890980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044b428-513b-4016-bdc5-9059e3cfbaec None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:53.890980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 506/1010] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:53.896055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4dbd9-5f0b-4cf5-8b22-10320314a741 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:53.896368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4dbd9-5f0b-4cf5-8b22-10320314a741 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:53.896647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4dbd9-5f0b-4cf5-8b22-10320314a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:53.914979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d6f4dbd9-5f0b-4cf5-8b22-10320314a741 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:53.916157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d6f4dbd9-5f0b-4cf5-8b22-10320314a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:53.956057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccf8be-9e03-49a8-84c3-d10c5580cd93 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:53.986692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 507/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:53.991513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a81d-ba25-440b-b2a0-6e5a13192971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:53.992143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a81d-ba25-440b-b2a0-6e5a13192971 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:53.992455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a81d-ba25-440b-b2a0-6e5a13192971 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:53.992728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a81d-ba25-440b-b2a0-6e5a13192971 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:53.993846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a81d-ba25-440b-b2a0-6e5a13192971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:53.995280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a81d-ba25-440b-b2a0-6e5a13192971 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:54.000337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 505/1012] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:54.002419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4dbd9-5f0b-4cf5-8b22-10320314a741 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:54.099229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:54.106450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4dbd9-5f0b-4cf5-8b22-10320314a741 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:54.139176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f96feb-efd1-4361-9b6c-27ee7ee6764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:54.139787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96feb-efd1-4361-9b6c-27ee7ee6764d None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:54.140068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96feb-efd1-4361-9b6c-27ee7ee6764d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:54.140372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96feb-efd1-4361-9b6c-27ee7ee6764d None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:54.141031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f96feb-efd1-4361-9b6c-27ee7ee6764d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:54.142448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f96feb-efd1-4361-9b6c-27ee7ee6764d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:54.238645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 508/1013] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:07:54 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:54.260521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a81d-ba25-440b-b2a0-6e5a13192971 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:54.307337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:54.376283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a81d-ba25-440b-b2a0-6e5a13192971 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:54.414469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:54.415113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:54.415393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:54.415681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] PATH_INFO: `/v3/services/compute` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:54.416257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:54.417657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:54.426606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:54.427744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:54.428842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 506/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:54.434900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f96feb-efd1-4361-9b6c-27ee7ee6764d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:54.539468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f96feb-efd1-4361-9b6c-27ee7ee6764d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:54.574187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f2ebc-9923-4415-8ed8-5333466ad2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:54.574795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2ebc-9923-4415-8ed8-5333466ad2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:54.575074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2ebc-9923-4415-8ed8-5333466ad2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:54.575343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f2ebc-9923-4415-8ed8-5333466ad2e2 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:54.576033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2ebc-9923-4415-8ed8-5333466ad2e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:54.576359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2ebc-9923-4415-8ed8-5333466ad2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:54.577859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f2ebc-9923-4415-8ed8-5333466ad2e2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:54.582966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 509/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:54.589377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:54.610116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d211-7f11-414c-bd75-64bf80e78a3e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:54.610403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d211-7f11-414c-bd75-64bf80e78a3e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:54.610706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d211-7f11-414c-bd75-64bf80e78a3e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:54.612055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 510/1016] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:54.617848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698a16-24e6-4ad4-bd89-1783b56952ad None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:54.618139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698a16-24e6-4ad4-bd89-1783b56952ad None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:54.618420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698a16-24e6-4ad4-bd89-1783b56952ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:54.636898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1d698a16-24e6-4ad4-bd89-1783b56952ad None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:54.638026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d698a16-24e6-4ad4-bd89-1783b56952ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:54.640937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:54.703762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0e910-f70e-4943-b041-2deca8815bec None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:54.705630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:54.716778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 511/1017] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:54.739857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:54.740609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:54.740924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:54.741202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:54.741963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:54.742301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:54.743694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:54.754341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698a16-24e6-4ad4-bd89-1783b56952ad None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:54.755093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 507/1018] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 28 10:07:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:54.865175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698a16-24e6-4ad4-bd89-1783b56952ad None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:54.900345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3390f5-6d12-4194-87f0-6c8a13d4b43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:54.900884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3390f5-6d12-4194-87f0-6c8a13d4b43f None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:54.901159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3390f5-6d12-4194-87f0-6c8a13d4b43f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:54.901429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3390f5-6d12-4194-87f0-6c8a13d4b43f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:54.902098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3390f5-6d12-4194-87f0-6c8a13d4b43f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:54.903442 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3390f5-6d12-4194-87f0-6c8a13d4b43f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:54.914146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:54.980929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 512/1019] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:07:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:07:54.990860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:55.108037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88987b-e70b-44c2-a72f-00c9f9ad5a4a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:55.153743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb8f1b-9b05-453f-9cf3-522ce8ea91d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:55.154279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb8f1b-9b05-453f-9cf3-522ce8ea91d3 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:55.154556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb8f1b-9b05-453f-9cf3-522ce8ea91d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:55.154826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb8f1b-9b05-453f-9cf3-522ce8ea91d3 None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:55.155511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb8f1b-9b05-453f-9cf3-522ce8ea91d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:55.156963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb8f1b-9b05-453f-9cf3-522ce8ea91d3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:55.277716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 508/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:07:54 2022] POST /identity/v3/services => generated 242 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:56.210763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87639-5e08-4473-a450-adcdacc5ba46 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:56.211340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87639-5e08-4473-a450-adcdacc5ba46 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:56.211340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a87639-5e08-4473-a450-adcdacc5ba46 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:56.212834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 513/1021] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:56.217846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe06e1-5a34-4eea-b820-a2497ce2a1b6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:56.218231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe06e1-5a34-4eea-b820-a2497ce2a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:56.218407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe06e1-5a34-4eea-b820-a2497ce2a1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:56.236707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f1fe06e1-5a34-4eea-b820-a2497ce2a1b6 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:56.237895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f1fe06e1-5a34-4eea-b820-a2497ce2a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:56.254284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:56.312118 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 509/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:56.588045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a87639-5e08-4473-a450-adcdacc5ba46 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:56.691659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a87639-5e08-4473-a450-adcdacc5ba46 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:56.726772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d40cc-b587-4535-a301-5d75704f73f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:56.727397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d40cc-b587-4535-a301-5d75704f73f6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:56.727678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d40cc-b587-4535-a301-5d75704f73f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:56.727951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d40cc-b587-4535-a301-5d75704f73f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:56.729067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d40cc-b587-4535-a301-5d75704f73f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:56.730484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d40cc-b587-4535-a301-5d75704f73f6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:56.732049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 514/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:56.737669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe06e1-5a34-4eea-b820-a2497ce2a1b6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:56.838222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe06e1-5a34-4eea-b820-a2497ce2a1b6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:56.873892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86dd6d-bc8d-4f05-940d-3e1cbe07a255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:56.874519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dd6d-bc8d-4f05-940d-3e1cbe07a255 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:56.874794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dd6d-bc8d-4f05-940d-3e1cbe07a255 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:56.875067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dd6d-bc8d-4f05-940d-3e1cbe07a255 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:56.875740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86dd6d-bc8d-4f05-940d-3e1cbe07a255 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:56.877348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86dd6d-bc8d-4f05-940d-3e1cbe07a255 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:56.986166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 510/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:07:56 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:07:57.024004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287102-95b4-48cc-a6f1-cf80780da486 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.024397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287102-95b4-48cc-a6f1-cf80780da486 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.024619 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe287102-95b4-48cc-a6f1-cf80780da486 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.026125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 515/1025] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:57.031717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d710-090e-489c-ae96-6d3615cfd229 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.032016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d710-090e-489c-ae96-6d3615cfd229 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.032280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d710-090e-489c-ae96-6d3615cfd229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.042171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:57.054014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a753d710-090e-489c-ae96-6d3615cfd229 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:57.055242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a753d710-090e-489c-ae96-6d3615cfd229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:57.132013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 511/1026] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:57.220868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4af8-98dc-45f9-b98c-b3682b0bce50 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.221405 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4af8-98dc-45f9-b98c-b3682b0bce50 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.221405 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd4af8-98dc-45f9-b98c-b3682b0bce50 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.222894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 516/1027] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:07:57.228698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b7d43-53b4-490c-952a-84cf1b892d5b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.229093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b7d43-53b4-490c-952a-84cf1b892d5b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.229255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b7d43-53b4-490c-952a-84cf1b892d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.247419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e96b7d43-53b4-490c-952a-84cf1b892d5b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:57.248638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e96b7d43-53b4-490c-952a-84cf1b892d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:57.321430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 512/1028] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:07:57.403780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4af8-98dc-45f9-b98c-b3682b0bce50 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:57.468266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:57.508904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd4af8-98dc-45f9-b98c-b3682b0bce50 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:57.543051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8517f81-bcb7-42c0-babf-d0ffdd936a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:57.543682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8517f81-bcb7-42c0-babf-d0ffdd936a4c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.543965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8517f81-bcb7-42c0-babf-d0ffdd936a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.544238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8517f81-bcb7-42c0-babf-d0ffdd936a4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.555814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8517f81-bcb7-42c0-babf-d0ffdd936a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-c8517f81-bcb7-42c0-babf-d0ffdd936a4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:57.560673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:57.561607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:57.562618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 517/1029] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 10:07:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:57.568339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b7d43-53b4-490c-952a-84cf1b892d5b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:57.597254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8517f81-bcb7-42c0-babf-d0ffdd936a4c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:57.629558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:57.676861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b7d43-53b4-490c-952a-84cf1b892d5b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:57.719663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:57.720405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.720680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.721485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.722161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:57.722460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:57.723091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8517f81-bcb7-42c0-babf-d0ffdd936a4c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:57.725294 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:57.735002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 513/1030] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 10:07:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:57.740184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:57.751203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:57.765495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:57.766124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.766862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.767142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.767809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:57.769624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:57.782979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:57.784070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:57.788872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 518/1031] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 28 10:07:57 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:57.791201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:57.853104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f8b52-c7ef-4647-9677-a8b641aae3ec None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:57.878460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:57.887522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:57.888269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.888637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.888914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.899550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:57.901520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:57.915735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:57.916944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:57.918024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:57.918024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:57.918024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:57.918024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 514/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:07:57.919175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f9718-3c53-476a-b49c-c5bd757f4cc1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:57.922561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:57.963597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:57.964791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:57.965522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:57.965954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:57.966983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] RBAC: Adding query filter params (name=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:57.967436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:57.969722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:57.974705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 519/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:57.980383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:58.029762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eff331-24a1-412e-9e96-5c57a1bd5163 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:58.039698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:58.068453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:58.069565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.069859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.070125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:58.070787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:58.071093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:58.072503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:58.089792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 515/1034] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:58.090652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:58.090863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2e098-b163-4e88-aebb-46ef6332ddbb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:58.128748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:58.129354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.129634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.129908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:58.130549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] RBAC: Adding query filter params (type=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:58.130848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:58.132140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:58.132957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:58.143180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 520/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:58.145106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:58.198311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da03d1c-cc0d-4881-8b38-6e2893499345 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:58.234288 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:58.234933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.235113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.235386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:58.242982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:58.244467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:58.253844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3853-252f-403a-b3a7-1b0b9d16b7da None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:07:58.255886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:58.257215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:07:58.258189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 516/1036] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:07:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:58.262608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:58.277372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:58.296617 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:58.297223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.297506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.297783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:58.298492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] RBAC: Adding query filter params (interface=public, service_id=d0bb89932cc04194a426ebf4f151f82f, region_id=RegionOne) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:58.298800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:58.300161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:58.306549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 521/1037] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 10:07:58 2022] GET /identity/v3/endpoints?service_id=d0bb89932cc04194a426ebf4f151f82f&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:58.311827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:58.369482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:58.373745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c48b9-acb3-44a2-9277-b2823b59da5a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:58.411838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:58.412980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.413093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.413347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:58.414080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:58.414381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:58.415807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:58.416628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0d64f-2f02-49c5-a127-f8d0a2f3a404 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:58.435167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 517/1038] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:07:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:58.440671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:58.457716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37372d7e-af56-4561-9003-27ba4d2a4328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:58.458320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372d7e-af56-4561-9003-27ba4d2a4328 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.458605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372d7e-af56-4561-9003-27ba4d2a4328 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.458875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372d7e-af56-4561-9003-27ba4d2a4328 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:58.459564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37372d7e-af56-4561-9003-27ba4d2a4328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:58.461124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37372d7e-af56-4561-9003-27ba4d2a4328 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:58.476334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 522/1039] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:07:58 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:07:58.558714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60157f2c-5740-45bb-bb9f-a865c2de4de5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:58.594935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bee064-06de-4810-a1ff-b6519cac4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:58.595553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee064-06de-4810-a1ff-b6519cac4262 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.595833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee064-06de-4810-a1ff-b6519cac4262 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.596105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bee064-06de-4810-a1ff-b6519cac4262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:58.625957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:58.671365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bee064-06de-4810-a1ff-b6519cac4262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:58.672863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bee064-06de-4810-a1ff-b6519cac4262 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:58.776001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 518/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 10:07:58.777335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37372d7e-af56-4561-9003-27ba4d2a4328 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:58.833519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:58.890519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37372d7e-af56-4561-9003-27ba4d2a4328 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:58.929082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba4fab-9d04-475e-b8b8-e2c5700c0cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:58.929857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba4fab-9d04-475e-b8b8-e2c5700c0cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.930138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba4fab-9d04-475e-b8b8-e2c5700c0cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.930408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba4fab-9d04-475e-b8b8-e2c5700c0cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:58.941894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba4fab-9d04-475e-b8b8-e2c5700c0cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:58.943347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba4fab-9d04-475e-b8b8-e2c5700c0cd3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-65ba4fab-9d04-475e-b8b8-e2c5700c0cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:07:58.957818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:58.958902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:07:58.960934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:07:58.960934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:07:58.960934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:58.960934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 523/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:58.966919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bee064-06de-4810-a1ff-b6519cac4262 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:58.999005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c6e5a-f3c6-4f1a-bfc9-eacc0c28d326 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:58.999325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c6e5a-f3c6-4f1a-bfc9-eacc0c28d326 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:58.999557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c6e5a-f3c6-4f1a-bfc9-eacc0c28d326 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.000932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 524/1042] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:07:59.005886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23864cf-544b-466f-bffe-57bbeacc4736 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:59.006256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23864cf-544b-466f-bffe-57bbeacc4736 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:59.006734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23864cf-544b-466f-bffe-57bbeacc4736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.026418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b23864cf-544b-466f-bffe-57bbeacc4736 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:07:59.028487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b23864cf-544b-466f-bffe-57bbeacc4736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:07:59.030033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:59.079416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bee064-06de-4810-a1ff-b6519cac4262 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:59.108851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 525/1043] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:07:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:07:59.116712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:59.117319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:59.117597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:59.117870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.118520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:59.118824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:59.120275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:59.132923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 519/1044] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:59.138412 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23864cf-544b-466f-bffe-57bbeacc4736 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:59.166555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:59.239687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23864cf-544b-466f-bffe-57bbeacc4736 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:59.273296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:59.273917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:59.274182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:59.274454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.281040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:59.282484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:07:59.294394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:59.295279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:59.296189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:07:59.296189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:07:59.296189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:07:59.296189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:07:59.296189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:07:59.296189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:07:59.296189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:07:59.296189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:59.300366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 526/1045] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:59.301190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:59.376887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:59.403360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51177df3-c105-4a2f-b647-d2171d0c0b27 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:59.422234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:59.441699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:59.442575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:59.442854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:59.443126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.445909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:59.445909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:59.445909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:59.462065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 520/1046] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:59.467737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:59.473323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:59.489098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2ae87-ca26-4fe3-b7c0-b436f7ce72e2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:59.527827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b384c67-7011-49c9-bacb-1859a5fdbb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:59.528493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b384c67-7011-49c9-bacb-1859a5fdbb3e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:59.528825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b384c67-7011-49c9-bacb-1859a5fdbb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:59.529556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b384c67-7011-49c9-bacb-1859a5fdbb3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.540725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b384c67-7011-49c9-bacb-1859a5fdbb3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-0b384c67-7011-49c9-bacb-1859a5fdbb3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:07:59.546089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:07:59.547259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:07:59.548147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 527/1047] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:07:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:07:59.553532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b384c67-7011-49c9-bacb-1859a5fdbb3e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:59.583456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c915a3-6b7c-49b3-b4e8-cad7005c10cd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:59.622907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:59.623849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:59.624366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:59.624872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.625939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] RBAC: Adding query filter params (role.id=d6e675b96785422f9b58ee4d69294eee, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=7e8ce142e0c944b49053bd2a44ce4853) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:59.626567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:59.628272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:59.640340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 521/1048] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:07:59 2022] GET /identity/v3/role_assignments?user.id=7e8ce142e0c944b49053bd2a44ce4853&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=d6e675b96785422f9b58ee4d69294eee => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:07:59.664317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b384c67-7011-49c9-bacb-1859a5fdbb3e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:59.701684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:59.702300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:59.702579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:59.702853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.703526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:07:59.703826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:59.705236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:59.714744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 528/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:07:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:59.720588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:59.769957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:07:59.836101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aceaa6-c0df-4171-82d3-4a778a312eb9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:07:59.875268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47751e0e-a8c8-42b8-bfcd-9b033dc545fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:07:59.875903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47751e0e-a8c8-42b8-bfcd-9b033dc545fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:07:59.876186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47751e0e-a8c8-42b8-bfcd-9b033dc545fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:07:59.876485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47751e0e-a8c8-42b8-bfcd-9b033dc545fc None admin] PATH_INFO: `/v3/users/7dba4d2ac9a047b782adfef2553b1ec2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:07:59.890663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47751e0e-a8c8-42b8-bfcd-9b033dc545fc None admin] RBAC: Authorizing `identity:get_user(user_id=7dba4d2ac9a047b782adfef2553b1ec2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:07:59.892037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47751e0e-a8c8-42b8-bfcd-9b033dc545fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:07:59.899125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 522/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:07:59 2022] GET /identity/v3/users/7dba4d2ac9a047b782adfef2553b1ec2 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:07:59.900703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:07:59.913178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:00.003818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de95ef-aa5f-4878-af86-6e778019e327 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:00.037723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74219cd3-0409-43e4-a387-ba87ffd524ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:00.038437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219cd3-0409-43e4-a387-ba87ffd524ba None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:00.038722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219cd3-0409-43e4-a387-ba87ffd524ba None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:00.038996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74219cd3-0409-43e4-a387-ba87ffd524ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:00.110636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74219cd3-0409-43e4-a387-ba87ffd524ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:00.112104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74219cd3-0409-43e4-a387-ba87ffd524ba None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:00.122796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:00.212423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 529/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:07:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:00.218210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47751e0e-a8c8-42b8-bfcd-9b033dc545fc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:00.314689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:00.320396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47751e0e-a8c8-42b8-bfcd-9b033dc545fc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:00.354606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaf110-d25a-45b0-aba2-0af70097c450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:00.355239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf110-d25a-45b0-aba2-0af70097c450 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:00.355520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf110-d25a-45b0-aba2-0af70097c450 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:00.355792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaf110-d25a-45b0-aba2-0af70097c450 None admin] PATH_INFO: `/v3/projects/8fc7b58323a24667803afeb91060eb49` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:00.356919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaf110-d25a-45b0-aba2-0af70097c450 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc7b58323a24667803afeb91060eb49)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:00.358366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaf110-d25a-45b0-aba2-0af70097c450 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:00.368419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 523/1052] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:00 2022] GET /identity/v3/projects/8fc7b58323a24667803afeb91060eb49 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:00.368572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74219cd3-0409-43e4-a387-ba87ffd524ba None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:00.417800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcee2d-663a-4367-afed-0ae920224611 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:00.418113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcee2d-663a-4367-afed-0ae920224611 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:00.418359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcee2d-663a-4367-afed-0ae920224611 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:00.419853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 524/1053] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:00.424524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557963e2-a731-4cdd-a621-786a0e2d5d80 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:00.424810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557963e2-a731-4cdd-a621-786a0e2d5d80 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:00.425088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557963e2-a731-4cdd-a621-786a0e2d5d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:00.444648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-557963e2-a731-4cdd-a621-786a0e2d5d80 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:00.445839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-557963e2-a731-4cdd-a621-786a0e2d5d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:00.469637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74219cd3-0409-43e4-a387-ba87ffd524ba None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:00.481015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:00.506147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:00.507057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:00.507342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:00.507674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:00.508431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=8fc7b58323a24667803afeb91060eb49, user.id=7dba4d2ac9a047b782adfef2553b1ec2) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:00.508794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:00.510298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:00.520350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 530/1054] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:00 2022] GET /identity/v3/role_assignments?user.id=7dba4d2ac9a047b782adfef2553b1ec2&scope.project.id=8fc7b58323a24667803afeb91060eb49&role.id=fe95a036fa044c4bb408b793fba6436a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:00.525166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 525/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:08:00.795460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:00.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de0e99-14ca-4354-b20d-3f7b7e1c78a6 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:00.946350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:00.946991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:00.947266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:00.947592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] PATH_INFO: `/v3/services/image` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:00.948181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:00.949560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:00.960957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:00.962039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:00.962898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 531/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 28 10:08:00 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:00.970074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557963e2-a731-4cdd-a621-786a0e2d5d80 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:01.071341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:01.080434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557963e2-a731-4cdd-a621-786a0e2d5d80 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:01.120642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:01.121412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:01.121730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:01.122002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:01.122693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] RBAC: Adding query filter params (name=image) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:01.123001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:01.124405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:01.136096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 526/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:01.137400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:01.175421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:01.249679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f2776-632e-4cfc-bf50-79c3474e5750 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:01.284149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c121d-8ead-45c9-b231-636ed9ba1649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:01.284790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c121d-8ead-45c9-b231-636ed9ba1649 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:01.285069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c121d-8ead-45c9-b231-636ed9ba1649 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:01.285338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c121d-8ead-45c9-b231-636ed9ba1649 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:01.285968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c121d-8ead-45c9-b231-636ed9ba1649 None admin] RBAC: Adding query filter params (type=image) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:01.286268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c121d-8ead-45c9-b231-636ed9ba1649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:01.288683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c121d-8ead-45c9-b231-636ed9ba1649 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:01.298604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 532/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:01.299805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:01.405823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c7fdd-5f6c-41de-b05c-e691954961dd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:01.444482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480a1a6-ab32-46b5-a118-d78a901df9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:01.445098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a1a6-ab32-46b5-a118-d78a901df9c4 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:01.445372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a1a6-ab32-46b5-a118-d78a901df9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:01.445641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a1a6-ab32-46b5-a118-d78a901df9c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:01.446323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480a1a6-ab32-46b5-a118-d78a901df9c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:01.447686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480a1a6-ab32-46b5-a118-d78a901df9c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:01.522817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 527/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:08:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:08:01.546833 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a1a1-49ad-40a5-91a0-0176f4250dec None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:01.547437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a1a1-49ad-40a5-91a0-0176f4250dec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:01.547543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9a1a1-49ad-40a5-91a0-0176f4250dec None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:01.549325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 533/1060] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:01.556225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562274d3-0322-4c65-8ae1-0c2310c1f657 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:01.556787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562274d3-0322-4c65-8ae1-0c2310c1f657 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:01.557070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562274d3-0322-4c65-8ae1-0c2310c1f657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:01.577038 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-562274d3-0322-4c65-8ae1-0c2310c1f657 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:01.578315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-562274d3-0322-4c65-8ae1-0c2310c1f657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:01.592455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:01.667269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 528/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:01.940199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9a1a1-49ad-40a5-91a0-0176f4250dec None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:02.043483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:02.047872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9a1a1-49ad-40a5-91a0-0176f4250dec None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:02.081569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6ac7c-d6b9-4211-917d-0c5ad5b011a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:02.082706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6ac7c-d6b9-4211-917d-0c5ad5b011a2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:02.083232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6ac7c-d6b9-4211-917d-0c5ad5b011a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:02.083817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6ac7c-d6b9-4211-917d-0c5ad5b011a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:02.095534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6ac7c-d6b9-4211-917d-0c5ad5b011a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-dce6ac7c-d6b9-4211-917d-0c5ad5b011a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:02.101036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:02.102375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:08:02.103256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:02.107195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 534/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 10:08:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:02.108441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562274d3-0322-4c65-8ae1-0c2310c1f657 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:02.212548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562274d3-0322-4c65-8ae1-0c2310c1f657 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:02.246236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:02.246846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:02.247127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:02.247400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:02.248072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:02.248407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:02.249787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:02.262448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 529/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 10:08:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:02.263685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6ac7c-d6b9-4211-917d-0c5ad5b011a2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:02.365733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6ac7c-d6b9-4211-917d-0c5ad5b011a2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:02.399313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:02.399937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:02.400214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:02.400522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:02.410565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:02.412271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:08:02.427687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:02.428700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:08:02.429629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:08:02.429629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:02.429629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:02.430346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 535/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:02.434969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:02.438943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:02.541096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b7f60-4516-4b72-9eda-53356e5cac47 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:02.575961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32712c-d48c-4afe-a16b-5e6b064c2510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:02.576614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32712c-d48c-4afe-a16b-5e6b064c2510 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:02.576896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32712c-d48c-4afe-a16b-5e6b064c2510 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:02.577164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32712c-d48c-4afe-a16b-5e6b064c2510 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:02.577806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32712c-d48c-4afe-a16b-5e6b064c2510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:02.578110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32712c-d48c-4afe-a16b-5e6b064c2510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:02.579482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32712c-d48c-4afe-a16b-5e6b064c2510 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:02.598313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 530/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:02.598515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:02.599610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b7f64-a533-45cf-9e32-f39aa6e9486b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:02.600529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b7f64-a533-45cf-9e32-f39aa6e9486b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:02.600808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b7f64-a533-45cf-9e32-f39aa6e9486b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:02.603087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 531/1066] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:08:02.607219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fc7bd-35a2-447c-9aed-3f8442a6d204 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:02.607497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fc7bd-35a2-447c-9aed-3f8442a6d204 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:02.607764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fc7bd-35a2-447c-9aed-3f8442a6d204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:02.618034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:02.626121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-162fc7bd-35a2-447c-9aed-3f8442a6d204 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:02.627746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-162fc7bd-35a2-447c-9aed-3f8442a6d204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:02.693720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:02.703752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 532/1067] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:08:02.707581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d4c2-2597-4495-8429-6e20a2be1fa7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:02.741738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:02.742359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:02.742639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:02.742968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:02.750371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:02.751850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:08:02.763759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:02.764744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:08:02.765742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:02.768580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 536/1068] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:08:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:02.770544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fc7bd-35a2-447c-9aed-3f8442a6d204 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:02.875134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fc7bd-35a2-447c-9aed-3f8442a6d204 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:02.909802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:02.910402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:02.910677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:02.910942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:02.911661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:02.912242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:02.913685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:02.935628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 533/1069] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:08:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:02.936977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:02.972235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.012507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:03.033655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:03.044865 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a992dba-6272-4e88-8243-6f4242685021 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.081270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.081899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.082184 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.082461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.084889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cc80c-b248-4a36-8b43-7634a1aec591 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.093827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.095205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:08:03.109956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:03.110969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:08:03.117879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:08:03.117879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:03.117879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:03.117879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 537/1070] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:08:03.118351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.126972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8bae-3a54-42cd-a387-00d8107ca0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.130405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8bae-3a54-42cd-a387-00d8107ca0fe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.130405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8bae-3a54-42cd-a387-00d8107ca0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.130405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f8bae-3a54-42cd-a387-00d8107ca0fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.139753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f8bae-3a54-42cd-a387-00d8107ca0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-546f8bae-3a54-42cd-a387-00d8107ca0fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:03.145244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:03.146239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:08:03.148562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 534/1071] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:08:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:08:03.153191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8bae-3a54-42cd-a387-00d8107ca0fe None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.229623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd16420-d99b-4c4b-a0a1-e86575bb5372 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.255290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:03.265718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f8bae-3a54-42cd-a387-00d8107ca0fe None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.266952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.267635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.267858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.268123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.268809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:03.269119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.270482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.282304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:03.283155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 538/1072] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:03.289715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.306932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.307553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.307833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.308108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.308810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:03.309154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.310577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.320041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 535/1073] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:08:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:03.326200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.405515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77c8ca-c046-4bc9-ae3d-5de9adb44794 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.430609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1c29-2e63-43d8-ac51-5b5c3ae00571 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.443931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.444607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.444893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.445204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.452745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.454182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:08:03.467068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:03.468032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:03.469286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:08:03.469286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:08:03.469286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:08:03.469286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:08:03.469286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:08:03.469286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:08:03.469286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:08:03.469286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:03.469759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55befc-e97a-4653-a59a-449e534b8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.469759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55befc-e97a-4653-a59a-449e534b8c18 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.470249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 539/1074] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:08:03.472342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55befc-e97a-4653-a59a-449e534b8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.472683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55befc-e97a-4653-a59a-449e534b8c18 None admin] PATH_INFO: `/v3/users/7dba4d2ac9a047b782adfef2553b1ec2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.473905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55befc-e97a-4653-a59a-449e534b8c18 None admin] RBAC: Authorizing `identity:get_user(user_id=7dba4d2ac9a047b782adfef2553b1ec2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.474237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.475842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55befc-e97a-4653-a59a-449e534b8c18 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.477496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 536/1075] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:03 2022] GET /identity/v3/users/7dba4d2ac9a047b782adfef2553b1ec2 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:03.483430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af7dc6-0326-46b3-a601-6842b97cac77 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.483717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af7dc6-0326-46b3-a601-6842b97cac77 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.483989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af7dc6-0326-46b3-a601-6842b97cac77 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.485347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 537/1076] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:03.487954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af7dc6-0326-46b3-a601-6842b97cac77 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.520417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:03.531449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:03.574177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b71909-3848-494f-9878-3dfe356576c9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.588026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af7dc6-0326-46b3-a601-6842b97cac77 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.607593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2209de-587c-42a6-bf21-582070e0dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.608279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2209de-587c-42a6-bf21-582070e0dba2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.608595 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2209de-587c-42a6-bf21-582070e0dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.608865 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2209de-587c-42a6-bf21-582070e0dba2 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.609549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2209de-587c-42a6-bf21-582070e0dba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:03.609853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2209de-587c-42a6-bf21-582070e0dba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.611255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2209de-587c-42a6-bf21-582070e0dba2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.621946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0b6fa-5e68-4af4-854b-ebf4f1cdf93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.622565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0b6fa-5e68-4af4-854b-ebf4f1cdf93f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.622838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0b6fa-5e68-4af4-854b-ebf4f1cdf93f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.623104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0b6fa-5e68-4af4-854b-ebf4f1cdf93f None admin] PATH_INFO: `/v3/projects/8fc7b58323a24667803afeb91060eb49` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.623469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 540/1077] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:03.624658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341675-a16d-4c17-8d9e-21d5cfec80c2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.624937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341675-a16d-4c17-8d9e-21d5cfec80c2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.625207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6341675-a16d-4c17-8d9e-21d5cfec80c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.629219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0b6fa-5e68-4af4-854b-ebf4f1cdf93f None admin] RBAC: Authorizing `identity:get_project(project_id=8fc7b58323a24667803afeb91060eb49)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.630651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0b6fa-5e68-4af4-854b-ebf4f1cdf93f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.633087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 538/1078] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:03 2022] GET /identity/v3/projects/8fc7b58323a24667803afeb91060eb49 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:03.634228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0b6fa-5e68-4af4-854b-ebf4f1cdf93f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.645019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c6341675-a16d-4c17-8d9e-21d5cfec80c2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:03.646198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c6341675-a16d-4c17-8d9e-21d5cfec80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:03.713076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 541/1079] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:03.713618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6341675-a16d-4c17-8d9e-21d5cfec80c2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:03.738640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0b6fa-5e68-4af4-854b-ebf4f1cdf93f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.747279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:03.749702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:03.774043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac1b1-e3ad-4b35-98f8-df423f7223c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.774695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac1b1-e3ad-4b35-98f8-df423f7223c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.774974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac1b1-e3ad-4b35-98f8-df423f7223c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.775244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ac1b1-e3ad-4b35-98f8-df423f7223c2 None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/7e8ce142e0c944b49053bd2a44ce4853/roles/d6e675b96785422f9b58ee4d69294eee` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.777438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ac1b1-e3ad-4b35-98f8-df423f7223c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=7e8ce142e0c944b49053bd2a44ce4853, role_id=d6e675b96785422f9b58ee4d69294eee)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.778961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ac1b1-e3ad-4b35-98f8-df423f7223c2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.814805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6341675-a16d-4c17-8d9e-21d5cfec80c2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:03.842902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 539/1080] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:08:03 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/7e8ce142e0c944b49053bd2a44ce4853/roles/d6e675b96785422f9b58ee4d69294eee => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:08:03.855715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7849c-ce5b-4851-8248-28338a140305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:03.856437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7849c-ce5b-4851-8248-28338a140305 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:03.856725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7849c-ce5b-4851-8248-28338a140305 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:03.857003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7849c-ce5b-4851-8248-28338a140305 None admin] PATH_INFO: `/v3/projects/8fc7b58323a24667803afeb91060eb49/users/7dba4d2ac9a047b782adfef2553b1ec2/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:03.859231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7849c-ce5b-4851-8248-28338a140305 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fc7b58323a24667803afeb91060eb49, user_id=7dba4d2ac9a047b782adfef2553b1ec2, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:03.860815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7849c-ce5b-4851-8248-28338a140305 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:03.947632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 542/1081] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:08:03 2022] PUT /identity/v3/projects/8fc7b58323a24667803afeb91060eb49/users/7dba4d2ac9a047b782adfef2553b1ec2/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:08:03.985975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac1b1-e3ad-4b35-98f8-df423f7223c2 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:04.102087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ac1b1-e3ad-4b35-98f8-df423f7223c2 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:04.139646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724ec3c-78e4-46b0-849c-90c593e7c0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:04.140268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724ec3c-78e4-46b0-849c-90c593e7c0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:04.140579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724ec3c-78e4-46b0-849c-90c593e7c0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:04.140853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724ec3c-78e4-46b0-849c-90c593e7c0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:04.182109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:04.211027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724ec3c-78e4-46b0-849c-90c593e7c0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:04.212687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724ec3c-78e4-46b0-849c-90c593e7c0d1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:04.315705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 540/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:04.321655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7849c-ce5b-4851-8248-28338a140305 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:04.418404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:04.425274 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7849c-ce5b-4851-8248-28338a140305 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:04.460469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73bf04-e5f9-495b-b625-8b56b98caaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:04.461105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73bf04-e5f9-495b-b625-8b56b98caaff None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:04.461384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73bf04-e5f9-495b-b625-8b56b98caaff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:04.461656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73bf04-e5f9-495b-b625-8b56b98caaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:04.471717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73bf04-e5f9-495b-b625-8b56b98caaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:04.473196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73bf04-e5f9-495b-b625-8b56b98caaff None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-9c73bf04-e5f9-495b-b625-8b56b98caaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:08:04.489427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:04.490419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:08:04.496825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:08:04.496825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:04.496825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:04.496825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 543/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:08:04.497064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724ec3c-78e4-46b0-849c-90c593e7c0d1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:04.567452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:04.598450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724ec3c-78e4-46b0-849c-90c593e7c0d1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:04.632503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ea177-7811-4369-9fe8-11369ddc881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:04.633104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea177-7811-4369-9fe8-11369ddc881f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:04.633383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea177-7811-4369-9fe8-11369ddc881f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:04.633652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ea177-7811-4369-9fe8-11369ddc881f None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:04.634296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ea177-7811-4369-9fe8-11369ddc881f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:04.634595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ea177-7811-4369-9fe8-11369ddc881f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:04.635960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ea177-7811-4369-9fe8-11369ddc881f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:04.648111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 541/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:05.755655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5379cd-e974-4807-a130-efacd60178c1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:05.756251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5379cd-e974-4807-a130-efacd60178c1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:05.756465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5379cd-e974-4807-a130-efacd60178c1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:05.757953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 544/1085] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:05.762869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd0d6-1e6d-4c49-84f9-4b9c6bc74585 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:05.763274 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd0d6-1e6d-4c49-84f9-4b9c6bc74585 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:05.763555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd0d6-1e6d-4c49-84f9-4b9c6bc74585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:05.781106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8c6cd0d6-1e6d-4c49-84f9-4b9c6bc74585 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:05.782275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8c6cd0d6-1e6d-4c49-84f9-4b9c6bc74585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:05.852149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 542/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:05.869069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3374-6be4-4079-8fd3-1f7f69e2a272 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:05.869443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3374-6be4-4079-8fd3-1f7f69e2a272 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:05.869782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3374-6be4-4079-8fd3-1f7f69e2a272 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:05.871167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 545/1087] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:05.876253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bff34-3b96-4f49-88f4-148f94b34fda None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:05.876572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bff34-3b96-4f49-88f4-148f94b34fda None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:05.876850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bff34-3b96-4f49-88f4-148f94b34fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:05.895197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-549bff34-3b96-4f49-88f4-148f94b34fda None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:05.896452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-549bff34-3b96-4f49-88f4-148f94b34fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:05.950940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:05.961857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 543/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:08:06.124185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e3374-6be4-4079-8fd3-1f7f69e2a272 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.231145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bff34-3b96-4f49-88f4-148f94b34fda None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.251996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e3374-6be4-4079-8fd3-1f7f69e2a272 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.285908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764802-bb84-4cf2-8747-8257b8a2cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.286507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764802-bb84-4cf2-8747-8257b8a2cada None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.286789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764802-bb84-4cf2-8747-8257b8a2cada None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.287364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764802-bb84-4cf2-8747-8257b8a2cada None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.297446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16764802-bb84-4cf2-8747-8257b8a2cada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-16764802-bb84-4cf2-8747-8257b8a2cada None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:06.302237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:06.303782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:06.304726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 546/1089] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:06.310046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764802-bb84-4cf2-8747-8257b8a2cada None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.319891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:06.331754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bff34-3b96-4f49-88f4-148f94b34fda None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.366444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357943-c50f-4d21-be51-99a48a3bcf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.367070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357943-c50f-4d21-be51-99a48a3bcf03 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.367350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357943-c50f-4d21-be51-99a48a3bcf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.367630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357943-c50f-4d21-be51-99a48a3bcf03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.377573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7357943-c50f-4d21-be51-99a48a3bcf03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f7357943-c50f-4d21-be51-99a48a3bcf03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:06.382353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:06.383485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:08:06.384407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 544/1090] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:08:06.389326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357943-c50f-4d21-be51-99a48a3bcf03 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.409483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764802-bb84-4cf2-8747-8257b8a2cada None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.439142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:06.444769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.445375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.445657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.445941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.446606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:06.451032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:06.451032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:06.456106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 547/1091] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:06.462026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.492408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357943-c50f-4d21-be51-99a48a3bcf03 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.524965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.525573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.525866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.526142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.526811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:06.527127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:06.527246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:06.528542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:06.536513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 545/1092] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:06.542955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.562108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002d4e-d0b6-4168-9dd6-34a9eb6ddb84 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.596403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.597022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.597297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.597568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.609090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:06.610513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:08:06.625133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:06.626303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:08:06.627319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:08:06.627319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:06.627319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:06.627319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 548/1093] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:08:06.632448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.641986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f97d-9236-42d6-b30e-b777611b7609 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.654485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:06.675823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb28eb-9dad-416c-ba0a-46de097452af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.676496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb28eb-9dad-416c-ba0a-46de097452af None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.676834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb28eb-9dad-416c-ba0a-46de097452af None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.677117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb28eb-9dad-416c-ba0a-46de097452af None admin] PATH_INFO: `/v3/users/7dba4d2ac9a047b782adfef2553b1ec2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.678881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb28eb-9dad-416c-ba0a-46de097452af None admin] RBAC: Authorizing `identity:get_user(user_id=7dba4d2ac9a047b782adfef2553b1ec2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:06.680339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb28eb-9dad-416c-ba0a-46de097452af None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:06.686834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 546/1094] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/users/7dba4d2ac9a047b782adfef2553b1ec2 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:06.687640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb28eb-9dad-416c-ba0a-46de097452af None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.731635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a003593-6867-4b66-b132-e13759949b9f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.750993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:06.764704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.765295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.765581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.765854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.766503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:06.766807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:06.768164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:06.780597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 549/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:06.783629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb28eb-9dad-416c-ba0a-46de097452af None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.786298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.817768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac15d0d-7269-4a5e-859e-c73d8ef371c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.818377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15d0d-7269-4a5e-859e-c73d8ef371c1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.818662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15d0d-7269-4a5e-859e-c73d8ef371c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.818938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15d0d-7269-4a5e-859e-c73d8ef371c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.867404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:06.886650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac15d0d-7269-4a5e-859e-c73d8ef371c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:06.888047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac15d0d-7269-4a5e-859e-c73d8ef371c1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:06.888390 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb4b7f-6b0a-4328-8053-8007246612a7 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:06.925069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:06.925694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:06.925975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:06.926247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:06.933614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:06.935054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:08:06.946556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:06.947663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:06.948699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 550/1096] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:08:06.953535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.987919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 547/1097] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:06.993984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac15d0d-7269-4a5e-859e-c73d8ef371c1 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:06.996108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:07.054773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18900970-4c8e-4e15-807b-0665c9afa4ff None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:07.073799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:07.088378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:07.089025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:07.089343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:07.089614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:07.090336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:07.090634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:07.092043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:07.092885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac15d0d-7269-4a5e-859e-c73d8ef371c1 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:07.109046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 551/1098] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:07.114796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:07.127123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db5808-9684-4000-9c04-190a2a0343cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:07.127752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5808-9684-4000-9c04-190a2a0343cc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:07.128030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5808-9684-4000-9c04-190a2a0343cc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:07.128319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db5808-9684-4000-9c04-190a2a0343cc None admin] PATH_INFO: `/v3/projects/8fc7b58323a24667803afeb91060eb49` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:07.129552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db5808-9684-4000-9c04-190a2a0343cc None admin] RBAC: Authorizing `identity:get_project(project_id=8fc7b58323a24667803afeb91060eb49)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:07.131509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db5808-9684-4000-9c04-190a2a0343cc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:07.133205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 548/1099] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:06 2022] GET /identity/v3/projects/8fc7b58323a24667803afeb91060eb49 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:07.139593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db5808-9684-4000-9c04-190a2a0343cc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:07.210260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:07.214002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3f96d-53e8-4b21-87d1-75dd6254077e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:07.242549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db5808-9684-4000-9c04-190a2a0343cc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:07.248654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05b914-7088-4698-9185-df4207752bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:07.249262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05b914-7088-4698-9185-df4207752bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:07.249547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05b914-7088-4698-9185-df4207752bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:07.249822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05b914-7088-4698-9185-df4207752bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:07.276200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:07.276834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:07.277121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:07.277391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:07.278177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=8fc7b58323a24667803afeb91060eb49, user.id=7dba4d2ac9a047b782adfef2553b1ec2) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:07.278486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:07.279918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:07.300325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 549/1100] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:07 2022] GET /identity/v3/role_assignments?user.id=7dba4d2ac9a047b782adfef2553b1ec2&scope.project.id=8fc7b58323a24667803afeb91060eb49&role.id=fe95a036fa044c4bb408b793fba6436a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:07.321717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05b914-7088-4698-9185-df4207752bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:07.323199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05b914-7088-4698-9185-df4207752bf0 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:07.422770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:07.427332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 552/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 10:08:07.433841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:07.449321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:07.535855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f301-df89-4bb4-bae6-dd5e362b42d9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:07.569740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:07.570363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:07.570643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:07.570918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:07.581899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:07.583344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:08:07.597508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:07.603310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:08:07.604377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:08:07.604377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:08:07.604377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:08:07.604377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 550/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:07.604621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05b914-7088-4698-9185-df4207752bf0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:07.702056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05b914-7088-4698-9185-df4207752bf0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:07.735534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:07.736132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:07.736437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:07.736713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:07.737350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:07.737651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:07.739018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:07.750133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 553/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:07.755838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:07.820482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:07.862090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454a051-299f-493b-91c1-703e6f907edd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:07.894729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:07.895340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:07.895617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:07.895885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:07.903092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:07.904569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:08:07.916474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:07.922772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:08:07.923926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 551/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:08:07.924474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:07.982178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:08.022911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25752c-79c2-4f5a-80bc-24ba4c34abab None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:08.054867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee22e2-93b0-4b28-b098-eb16e677857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:08.055460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee22e2-93b0-4b28-b098-eb16e677857e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:08.055739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee22e2-93b0-4b28-b098-eb16e677857e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:08.056011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee22e2-93b0-4b28-b098-eb16e677857e None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:08.056732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee22e2-93b0-4b28-b098-eb16e677857e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:08.057035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee22e2-93b0-4b28-b098-eb16e677857e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:08.058438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee22e2-93b0-4b28-b098-eb16e677857e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:08.070520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 554/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:08.076557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:08.175143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed63d2-40d1-4a30-bdde-259f9445df44 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:08.198498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:08.208711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377621f-16b6-49b1-85dc-083a554116c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:08.209553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377621f-16b6-49b1-85dc-083a554116c2 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:08.209830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377621f-16b6-49b1-85dc-083a554116c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:08.210102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377621f-16b6-49b1-85dc-083a554116c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:08.210827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377621f-16b6-49b1-85dc-083a554116c2 None admin] RBAC: Adding query filter params (role.id=d6e675b96785422f9b58ee4d69294eee, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=7e8ce142e0c944b49053bd2a44ce4853) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:08.211132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377621f-16b6-49b1-85dc-083a554116c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:08.212576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377621f-16b6-49b1-85dc-083a554116c2 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:08.218153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 552/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:08 2022] GET /identity/v3/role_assignments?user.id=7e8ce142e0c944b49053bd2a44ce4853&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=d6e675b96785422f9b58ee4d69294eee => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:09.222798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170f1a-8fb7-4b8d-acf4-d1cb317c8795 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:09.223355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170f1a-8fb7-4b8d-acf4-d1cb317c8795 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:09.223355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10170f1a-8fb7-4b8d-acf4-d1cb317c8795 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:09.224758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 555/1107] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:09.230069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff02cb-1727-416c-8a89-a47a3003bfaa None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:09.230495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff02cb-1727-416c-8a89-a47a3003bfaa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:09.230605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff02cb-1727-416c-8a89-a47a3003bfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:09.248811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-26ff02cb-1727-416c-8a89-a47a3003bfaa None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:09.249988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-26ff02cb-1727-416c-8a89-a47a3003bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:09.314483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 553/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:09.586606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170f1a-8fb7-4b8d-acf4-d1cb317c8795 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:09.685982 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10170f1a-8fb7-4b8d-acf4-d1cb317c8795 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:09.702353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:09.718915 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c584a05-ce6f-4bae-ac37-c6992a825207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:09.726629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584a05-ce6f-4bae-ac37-c6992a825207 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:09.726629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584a05-ce6f-4bae-ac37-c6992a825207 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:09.726629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584a05-ce6f-4bae-ac37-c6992a825207 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:09.726629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c584a05-ce6f-4bae-ac37-c6992a825207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:09.726629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c584a05-ce6f-4bae-ac37-c6992a825207 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:09.726629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 556/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:09.730783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff02cb-1727-416c-8a89-a47a3003bfaa None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:09.824936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff02cb-1727-416c-8a89-a47a3003bfaa None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:09.842526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:09.859239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7226521-c470-4541-afef-5c4d0d3cfb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:09.859844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7226521-c470-4541-afef-5c4d0d3cfb56 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:09.860122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7226521-c470-4541-afef-5c4d0d3cfb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:09.860423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7226521-c470-4541-afef-5c4d0d3cfb56 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:09.861087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7226521-c470-4541-afef-5c4d0d3cfb56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:09.862509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7226521-c470-4541-afef-5c4d0d3cfb56 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:09.955924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 554/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:08:09 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:08:11.892194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b5579-9b93-4a4c-938f-99f425957616 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:11.892720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b5579-9b93-4a4c-938f-99f425957616 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:11.892922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b5579-9b93-4a4c-938f-99f425957616 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:11.894272 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 557/1111] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:11.900186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325f8b-a618-44ac-b4ec-f70819399769 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:11.900644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325f8b-a618-44ac-b4ec-f70819399769 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:11.900774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75325f8b-a618-44ac-b4ec-f70819399769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:11.918780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-75325f8b-a618-44ac-b4ec-f70819399769 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:11.919966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-75325f8b-a618-44ac-b4ec-f70819399769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:11.984246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 555/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:12.252208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b5579-9b93-4a4c-938f-99f425957616 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:12.351733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b5579-9b93-4a4c-938f-99f425957616 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:12.384774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7cb68-89bd-476e-aa4b-5f11a88e6550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:12.385387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7cb68-89bd-476e-aa4b-5f11a88e6550 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:12.385670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7cb68-89bd-476e-aa4b-5f11a88e6550 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:12.385946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7cb68-89bd-476e-aa4b-5f11a88e6550 None admin] PATH_INFO: `/v3/roles/ca65b374d43c43aabe987aabb7147e99` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:12.387332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7cb68-89bd-476e-aa4b-5f11a88e6550 None admin] RBAC: Authorizing `identity:get_role(role_id=ca65b374d43c43aabe987aabb7147e99)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:12.388731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7cb68-89bd-476e-aa4b-5f11a88e6550 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:12.390039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 558/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:12 2022] GET /identity/v3/roles/ca65b374d43c43aabe987aabb7147e99 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:12.395802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75325f8b-a618-44ac-b4ec-f70819399769 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:12.493155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75325f8b-a618-44ac-b4ec-f70819399769 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:12.495422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:12.525482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959028-ca9c-4418-afc5-e66265248e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:12.526043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959028-ca9c-4418-afc5-e66265248e28 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:12.526322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959028-ca9c-4418-afc5-e66265248e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:12.526619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959028-ca9c-4418-afc5-e66265248e28 None admin] PATH_INFO: `/v3/users/9e2de23502c345df88bd05de7b647d8f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:12.540280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e959028-ca9c-4418-afc5-e66265248e28 None admin] RBAC: Authorizing `identity:get_user(user_id=9e2de23502c345df88bd05de7b647d8f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:12.541758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e959028-ca9c-4418-afc5-e66265248e28 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:12.543344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 556/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:12 2022] GET /identity/v3/users/9e2de23502c345df88bd05de7b647d8f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:12.549143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7cb68-89bd-476e-aa4b-5f11a88e6550 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:12.603717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:12.647249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7cb68-89bd-476e-aa4b-5f11a88e6550 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:12.680651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351ae3c-67f7-4d9f-ab1b-dc414312745a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:12.681249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351ae3c-67f7-4d9f-ab1b-dc414312745a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:12.681532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351ae3c-67f7-4d9f-ab1b-dc414312745a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:12.681803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351ae3c-67f7-4d9f-ab1b-dc414312745a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:12.746115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351ae3c-67f7-4d9f-ab1b-dc414312745a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:12.747557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351ae3c-67f7-4d9f-ab1b-dc414312745a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:12.799434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:12.843340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 559/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:12.849195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959028-ca9c-4418-afc5-e66265248e28 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:12.944263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959028-ca9c-4418-afc5-e66265248e28 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:12.977272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e63455-90c9-4dc3-af09-de952f946d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:12.977868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e63455-90c9-4dc3-af09-de952f946d4b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:12.978143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e63455-90c9-4dc3-af09-de952f946d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:12.978412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e63455-90c9-4dc3-af09-de952f946d4b None admin] PATH_INFO: `/v3/projects/8fc7b58323a24667803afeb91060eb49` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:12.979508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e63455-90c9-4dc3-af09-de952f946d4b None admin] RBAC: Authorizing `identity:get_project(project_id=8fc7b58323a24667803afeb91060eb49)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:12.980966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e63455-90c9-4dc3-af09-de952f946d4b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:12.982545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 557/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:12 2022] GET /identity/v3/projects/8fc7b58323a24667803afeb91060eb49 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:12.988591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351ae3c-67f7-4d9f-ab1b-dc414312745a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:13.085281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351ae3c-67f7-4d9f-ab1b-dc414312745a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:13.118637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342cb75-b5b5-47f6-89b8-ea5233a6d019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:13.119231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cb75-b5b5-47f6-89b8-ea5233a6d019 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:13.119506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cb75-b5b5-47f6-89b8-ea5233a6d019 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:13.119776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cb75-b5b5-47f6-89b8-ea5233a6d019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:13.120523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cb75-b5b5-47f6-89b8-ea5233a6d019 None admin] RBAC: Adding query filter params (role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=8fc7b58323a24667803afeb91060eb49, user.id=9e2de23502c345df88bd05de7b647d8f) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:13.120838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cb75-b5b5-47f6-89b8-ea5233a6d019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:13.122244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cb75-b5b5-47f6-89b8-ea5233a6d019 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:13.127461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 560/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:12 2022] GET /identity/v3/role_assignments?user.id=9e2de23502c345df88bd05de7b647d8f&scope.project.id=8fc7b58323a24667803afeb91060eb49&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:15.009777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185ab5e-e702-4537-b426-f18bf962ea60 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:15.010337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185ab5e-e702-4537-b426-f18bf962ea60 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:15.010337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185ab5e-e702-4537-b426-f18bf962ea60 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:15.011657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 558/1118] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:15.016735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75634655-1663-45c5-815d-ca7de9c1b950 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:15.017116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75634655-1663-45c5-815d-ca7de9c1b950 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:15.017287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75634655-1663-45c5-815d-ca7de9c1b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:15.035155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-75634655-1663-45c5-815d-ca7de9c1b950 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:15.036358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-75634655-1663-45c5-815d-ca7de9c1b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:15.049300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:15.101552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 561/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:15.374695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185ab5e-e702-4537-b426-f18bf962ea60 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:15.403839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:15.472594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185ab5e-e702-4537-b426-f18bf962ea60 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:15.506948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aff6ae-0a18-4219-9661-f0f9b6b920ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:15.507565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff6ae-0a18-4219-9661-f0f9b6b920ee None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:15.507845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff6ae-0a18-4219-9661-f0f9b6b920ee None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:15.508125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff6ae-0a18-4219-9661-f0f9b6b920ee None admin] PATH_INFO: `/v3/roles/ca65b374d43c43aabe987aabb7147e99` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:15.509563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aff6ae-0a18-4219-9661-f0f9b6b920ee None admin] RBAC: Authorizing `identity:get_role(role_id=ca65b374d43c43aabe987aabb7147e99)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:15.510989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aff6ae-0a18-4219-9661-f0f9b6b920ee None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:15.512371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 559/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:15 2022] GET /identity/v3/roles/ca65b374d43c43aabe987aabb7147e99 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:15.518793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75634655-1663-45c5-815d-ca7de9c1b950 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:15.621302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75634655-1663-45c5-815d-ca7de9c1b950 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:15.653528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52def7-3180-41a6-abd2-733e0fcea796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:15.654084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52def7-3180-41a6-abd2-733e0fcea796 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:15.654361 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52def7-3180-41a6-abd2-733e0fcea796 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:15.654629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52def7-3180-41a6-abd2-733e0fcea796 None admin] PATH_INFO: `/v3/users/9e2de23502c345df88bd05de7b647d8f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:15.655718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52def7-3180-41a6-abd2-733e0fcea796 None admin] RBAC: Authorizing `identity:get_user(user_id=9e2de23502c345df88bd05de7b647d8f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:15.657149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52def7-3180-41a6-abd2-733e0fcea796 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:15.658700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 562/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:15 2022] GET /identity/v3/users/9e2de23502c345df88bd05de7b647d8f => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:15.665325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aff6ae-0a18-4219-9661-f0f9b6b920ee None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:15.759081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:15.762769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aff6ae-0a18-4219-9661-f0f9b6b920ee None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:15.796227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668facfe-ca06-4876-9ea2-a1955a73a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:15.797041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668facfe-ca06-4876-9ea2-a1955a73a331 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:15.797632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668facfe-ca06-4876-9ea2-a1955a73a331 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:15.797906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668facfe-ca06-4876-9ea2-a1955a73a331 None admin] PATH_INFO: `/v3/projects/8fc7b58323a24667803afeb91060eb49` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:15.799025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668facfe-ca06-4876-9ea2-a1955a73a331 None admin] RBAC: Authorizing `identity:get_project(project_id=8fc7b58323a24667803afeb91060eb49)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:15.800479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668facfe-ca06-4876-9ea2-a1955a73a331 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:15.802084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 560/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:15 2022] GET /identity/v3/projects/8fc7b58323a24667803afeb91060eb49 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:15.808067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52def7-3180-41a6-abd2-733e0fcea796 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:15.825959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:15.907126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52def7-3180-41a6-abd2-733e0fcea796 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:15.940372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f5e2-85f4-4d06-a420-9ee8bca7cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:15.941011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f5e2-85f4-4d06-a420-9ee8bca7cb19 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:15.941286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f5e2-85f4-4d06-a420-9ee8bca7cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:15.941555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f5e2-85f4-4d06-a420-9ee8bca7cb19 None admin] PATH_INFO: `/v3/projects/8fc7b58323a24667803afeb91060eb49/users/9e2de23502c345df88bd05de7b647d8f/roles/ca65b374d43c43aabe987aabb7147e99` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:15.943717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f5e2-85f4-4d06-a420-9ee8bca7cb19 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fc7b58323a24667803afeb91060eb49, user_id=9e2de23502c345df88bd05de7b647d8f, role_id=ca65b374d43c43aabe987aabb7147e99)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:15.945150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f5e2-85f4-4d06-a420-9ee8bca7cb19 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:16.064541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 563/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:08:15 2022] PUT /identity/v3/projects/8fc7b58323a24667803afeb91060eb49/users/9e2de23502c345df88bd05de7b647d8f/roles/ca65b374d43c43aabe987aabb7147e99 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:08:17.932247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c35ad-f980-405c-a130-30f14c4bf90a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:17.932784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c35ad-f980-405c-a130-30f14c4bf90a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:17.932886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c35ad-f980-405c-a130-30f14c4bf90a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:17.934141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 561/1124] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:17.939420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad68b8-3e9a-4f8c-bf65-f57f99148fc1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:17.939851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad68b8-3e9a-4f8c-bf65-f57f99148fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:17.939978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad68b8-3e9a-4f8c-bf65-f57f99148fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:17.958246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e4ad68b8-3e9a-4f8c-bf65-f57f99148fc1 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:17.959589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4ad68b8-3e9a-4f8c-bf65-f57f99148fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:18.023494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 564/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:18.291935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c35ad-f980-405c-a130-30f14c4bf90a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:18.390340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c35ad-f980-405c-a130-30f14c4bf90a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:18.422791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01aff2-f23e-401c-8976-193c4de9f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:18.423413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01aff2-f23e-401c-8976-193c4de9f22f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:18.423692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01aff2-f23e-401c-8976-193c4de9f22f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:18.423965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01aff2-f23e-401c-8976-193c4de9f22f None admin] PATH_INFO: `/v3/roles/ca65b374d43c43aabe987aabb7147e99` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:18.425385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01aff2-f23e-401c-8976-193c4de9f22f None admin] RBAC: Authorizing `identity:get_role(role_id=ca65b374d43c43aabe987aabb7147e99)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:18.426761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01aff2-f23e-401c-8976-193c4de9f22f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:18.428647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 562/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:18 2022] GET /identity/v3/roles/ca65b374d43c43aabe987aabb7147e99 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:18.434212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad68b8-3e9a-4f8c-bf65-f57f99148fc1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:18.442258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:18.530408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad68b8-3e9a-4f8c-bf65-f57f99148fc1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:18.563486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc5f1-1be1-443a-a6a0-e0f87d2d4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:18.564043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc5f1-1be1-443a-a6a0-e0f87d2d4836 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:18.564351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc5f1-1be1-443a-a6a0-e0f87d2d4836 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:18.564633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc5f1-1be1-443a-a6a0-e0f87d2d4836 None admin] PATH_INFO: `/v3/users/9e2de23502c345df88bd05de7b647d8f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:18.565742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bc5f1-1be1-443a-a6a0-e0f87d2d4836 None admin] RBAC: Authorizing `identity:get_user(user_id=9e2de23502c345df88bd05de7b647d8f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:18.567168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bc5f1-1be1-443a-a6a0-e0f87d2d4836 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:18.568927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 565/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:18 2022] GET /identity/v3/users/9e2de23502c345df88bd05de7b647d8f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:18.574561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01aff2-f23e-401c-8976-193c4de9f22f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:18.608956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:18.673571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01aff2-f23e-401c-8976-193c4de9f22f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:18.706244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455313-7346-4eb3-a3a5-d3864d6b2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:18.706847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455313-7346-4eb3-a3a5-d3864d6b2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:18.707126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455313-7346-4eb3-a3a5-d3864d6b2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:18.707397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c455313-7346-4eb3-a3a5-d3864d6b2ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:18.771711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c455313-7346-4eb3-a3a5-d3864d6b2ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:18.773177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c455313-7346-4eb3-a3a5-d3864d6b2ff3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:18.805105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:18.869256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 563/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:18.875219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc5f1-1be1-443a-a6a0-e0f87d2d4836 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:18.948273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:18.972008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc5f1-1be1-443a-a6a0-e0f87d2d4836 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:19.006075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6c736-6796-4d8a-8008-0744f9ff189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:19.006688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c736-6796-4d8a-8008-0744f9ff189a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:19.006972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c736-6796-4d8a-8008-0744f9ff189a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:19.007248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6c736-6796-4d8a-8008-0744f9ff189a None admin] PATH_INFO: `/v3/projects/8fc7b58323a24667803afeb91060eb49` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:19.008391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6c736-6796-4d8a-8008-0744f9ff189a None admin] RBAC: Authorizing `identity:get_project(project_id=8fc7b58323a24667803afeb91060eb49)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:19.009813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6c736-6796-4d8a-8008-0744f9ff189a None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:19.011426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 566/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:18 2022] GET /identity/v3/projects/8fc7b58323a24667803afeb91060eb49 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:08:19.017679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455313-7346-4eb3-a3a5-d3864d6b2ff3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:19.113664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c455313-7346-4eb3-a3a5-d3864d6b2ff3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:19.145913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ecc3f-e4ec-4f08-b606-b9a5863495da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:19.146533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecc3f-e4ec-4f08-b606-b9a5863495da None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:19.146807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecc3f-e4ec-4f08-b606-b9a5863495da None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:19.147081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ecc3f-e4ec-4f08-b606-b9a5863495da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:19.147804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ecc3f-e4ec-4f08-b606-b9a5863495da None admin] RBAC: Adding query filter params (role.id=ca65b374d43c43aabe987aabb7147e99, scope.project.id=8fc7b58323a24667803afeb91060eb49, user.id=9e2de23502c345df88bd05de7b647d8f) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:19.148109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ecc3f-e4ec-4f08-b606-b9a5863495da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:19.149563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ecc3f-e4ec-4f08-b606-b9a5863495da None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:19.151285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:19.155603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 564/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:19 2022] GET /identity/v3/role_assignments?user.id=9e2de23502c345df88bd05de7b647d8f&scope.project.id=8fc7b58323a24667803afeb91060eb49&role.id=ca65b374d43c43aabe987aabb7147e99 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:21.054315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c0519-c8e5-4c04-8935-67bdf0165ebb None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:21.054866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c0519-c8e5-4c04-8935-67bdf0165ebb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:21.054866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c0519-c8e5-4c04-8935-67bdf0165ebb None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:21.056176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 567/1131] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:21.061429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f4bf-f280-421c-a89d-75da53028f65 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:21.061845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f4bf-f280-421c-a89d-75da53028f65 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:21.061986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648f4bf-f280-421c-a89d-75da53028f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:21.079785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0648f4bf-f280-421c-a89d-75da53028f65 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:21.080995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0648f4bf-f280-421c-a89d-75da53028f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:21.145211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 565/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:08:21.413769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c0519-c8e5-4c04-8935-67bdf0165ebb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:21.512898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c0519-c8e5-4c04-8935-67bdf0165ebb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:21.546174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c09e68-b115-4ac9-824d-201533343289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:21.546784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09e68-b115-4ac9-824d-201533343289 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:21.547064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09e68-b115-4ac9-824d-201533343289 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:21.547337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c09e68-b115-4ac9-824d-201533343289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:21.548470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c09e68-b115-4ac9-824d-201533343289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:21.549893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c09e68-b115-4ac9-824d-201533343289 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:21.551436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 568/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:21.557260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648f4bf-f280-421c-a89d-75da53028f65 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:21.652594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648f4bf-f280-421c-a89d-75da53028f65 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:21.678627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:21.686279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4852ac-b388-4e1b-9a75-aad8f5a2cf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:21.686879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4852ac-b388-4e1b-9a75-aad8f5a2cf66 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:21.687161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4852ac-b388-4e1b-9a75-aad8f5a2cf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:21.687437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4852ac-b388-4e1b-9a75-aad8f5a2cf66 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:21.688105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4852ac-b388-4e1b-9a75-aad8f5a2cf66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:21.689611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4852ac-b388-4e1b-9a75-aad8f5a2cf66 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:21.808920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 566/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:08:21 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:08:23.730605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5973-73a7-436c-9858-eddbfd71621d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:23.731164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5973-73a7-436c-9858-eddbfd71621d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:23.731164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5973-73a7-436c-9858-eddbfd71621d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:23.732523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 569/1135] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:23.737754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bca436-52ac-41aa-a548-dba093dc25bb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:23.738158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bca436-52ac-41aa-a548-dba093dc25bb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:23.738286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bca436-52ac-41aa-a548-dba093dc25bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:23.756711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-67bca436-52ac-41aa-a548-dba093dc25bb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:23.757875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-67bca436-52ac-41aa-a548-dba093dc25bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:23.821177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 567/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:24.094816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec5973-73a7-436c-9858-eddbfd71621d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:24.107659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:24.194561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec5973-73a7-436c-9858-eddbfd71621d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:24.228350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859cbe4-b440-4d8a-9bf1-de8e6e25ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:24.228963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859cbe4-b440-4d8a-9bf1-de8e6e25ed28 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:24.229244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859cbe4-b440-4d8a-9bf1-de8e6e25ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:24.229519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859cbe4-b440-4d8a-9bf1-de8e6e25ed28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:24.230623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859cbe4-b440-4d8a-9bf1-de8e6e25ed28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:24.232048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859cbe4-b440-4d8a-9bf1-de8e6e25ed28 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:24.233637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 570/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:08:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:24.239507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bca436-52ac-41aa-a548-dba093dc25bb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:24.336061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bca436-52ac-41aa-a548-dba093dc25bb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:24.346108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:24.367991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2106f-03c6-4df1-b9f5-ba4cc2140d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:24.368612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2106f-03c6-4df1-b9f5-ba4cc2140d60 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:24.368888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2106f-03c6-4df1-b9f5-ba4cc2140d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:24.369163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2106f-03c6-4df1-b9f5-ba4cc2140d60 None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:24.369895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2106f-03c6-4df1-b9f5-ba4cc2140d60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:24.371239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2106f-03c6-4df1-b9f5-ba4cc2140d60 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:24.475588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 568/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:08:24 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:08:26.397305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9382-e0b4-44c7-b343-c16fc45483f0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:26.397844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9382-e0b4-44c7-b343-c16fc45483f0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:26.397844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9382-e0b4-44c7-b343-c16fc45483f0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:26.399183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 571/1139] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:26.404263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925897ff-7dd0-443b-b0f7-7fa76940b284 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:26.404666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925897ff-7dd0-443b-b0f7-7fa76940b284 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:26.404853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925897ff-7dd0-443b-b0f7-7fa76940b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:26.422509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-925897ff-7dd0-443b-b0f7-7fa76940b284 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:26.423681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-925897ff-7dd0-443b-b0f7-7fa76940b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:26.487379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 569/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:26.758370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9382-e0b4-44c7-b343-c16fc45483f0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:26.836124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:26.858061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9382-e0b4-44c7-b343-c16fc45483f0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:26.891242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521bdfc-4e86-4eac-bcec-377fc5233103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:26.891855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521bdfc-4e86-4eac-bcec-377fc5233103 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:26.892142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521bdfc-4e86-4eac-bcec-377fc5233103 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:26.892445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521bdfc-4e86-4eac-bcec-377fc5233103 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:26.902485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521bdfc-4e86-4eac-bcec-377fc5233103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6521bdfc-4e86-4eac-bcec-377fc5233103 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:26.907287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:26.908531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:26.909678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 572/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:26.915544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925897ff-7dd0-443b-b0f7-7fa76940b284 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:27.005546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:27.016288 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925897ff-7dd0-443b-b0f7-7fa76940b284 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:27.045483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:27.046084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:27.047471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:27.047471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:27.047471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:27.047757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:27.049175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:27.057125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 570/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:27.062932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521bdfc-4e86-4eac-bcec-377fc5233103 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:27.229676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521bdfc-4e86-4eac-bcec-377fc5233103 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:27.262266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0288f-7616-480b-8507-3b1d00e237f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:27.262878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0288f-7616-480b-8507-3b1d00e237f1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:27.263159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0288f-7616-480b-8507-3b1d00e237f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:27.263551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0288f-7616-480b-8507-3b1d00e237f1 None admin] PATH_INFO: `/v3/users/6d815ecb03204069b5aa7a5479dfb4ce` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:27.271686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:27.277305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0288f-7616-480b-8507-3b1d00e237f1 None admin] RBAC: Authorizing `identity:get_user(user_id=6d815ecb03204069b5aa7a5479dfb4ce)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:27.278693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0288f-7616-480b-8507-3b1d00e237f1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:27.280347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 573/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:27 2022] GET /identity/v3/users/6d815ecb03204069b5aa7a5479dfb4ce => generated 286 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:27.286547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:27.384779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0531ca0-0261-4ead-90e8-6b4cbe17bc75 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:27.417750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4046d-67ee-45d6-b23f-9e09bed628a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:27.418340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4046d-67ee-45d6-b23f-9e09bed628a3 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:27.418614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4046d-67ee-45d6-b23f-9e09bed628a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:27.418887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4046d-67ee-45d6-b23f-9e09bed628a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:27.444763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:27.485612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4046d-67ee-45d6-b23f-9e09bed628a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:27.487050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d4046d-67ee-45d6-b23f-9e09bed628a3 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:27.581264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 571/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:27.587786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0288f-7616-480b-8507-3b1d00e237f1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:27.684843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0288f-7616-480b-8507-3b1d00e237f1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:27.718074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bc60d-baea-4797-a13f-6038513a476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:27.718687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bc60d-baea-4797-a13f-6038513a476d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:27.718969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bc60d-baea-4797-a13f-6038513a476d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:27.719244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bc60d-baea-4797-a13f-6038513a476d None admin] PATH_INFO: `/v3/projects/b47f48c664bc4a279774cbeaace2226a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:27.720456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bc60d-baea-4797-a13f-6038513a476d None admin] RBAC: Authorizing `identity:get_project(project_id=b47f48c664bc4a279774cbeaace2226a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:27.721879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bc60d-baea-4797-a13f-6038513a476d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:27.723478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 574/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:27 2022] GET /identity/v3/projects/b47f48c664bc4a279774cbeaace2226a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:27.729683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4046d-67ee-45d6-b23f-9e09bed628a3 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:27.785275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:27.825992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4046d-67ee-45d6-b23f-9e09bed628a3 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:27.859793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241d18e-d4c0-41a1-98c0-cdf773c16f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:27.860415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d18e-d4c0-41a1-98c0-cdf773c16f70 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:27.860693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d18e-d4c0-41a1-98c0-cdf773c16f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:27.860961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241d18e-d4c0-41a1-98c0-cdf773c16f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:27.861680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d18e-d4c0-41a1-98c0-cdf773c16f70 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=b47f48c664bc4a279774cbeaace2226a, user.id=6d815ecb03204069b5aa7a5479dfb4ce) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:27.861981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d18e-d4c0-41a1-98c0-cdf773c16f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:27.863409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241d18e-d4c0-41a1-98c0-cdf773c16f70 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:27.869300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 572/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:27 2022] GET /identity/v3/role_assignments?user.id=6d815ecb03204069b5aa7a5479dfb4ce&scope.project.id=b47f48c664bc4a279774cbeaace2226a&role.id=fe95a036fa044c4bb408b793fba6436a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:29.741923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee003b-5e58-471a-bf28-a4d5e6bf19e6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:29.742455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee003b-5e58-471a-bf28-a4d5e6bf19e6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:29.742455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee003b-5e58-471a-bf28-a4d5e6bf19e6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:29.743821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 575/1147] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:29.748901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a918-1cd2-4025-b590-e4a7f0b15ae7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:29.749336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a918-1cd2-4025-b590-e4a7f0b15ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:29.749438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a918-1cd2-4025-b590-e4a7f0b15ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:29.767360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2716a918-1cd2-4025-b590-e4a7f0b15ae7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:29.768552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2716a918-1cd2-4025-b590-e4a7f0b15ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:29.834177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 573/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:30.103776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee003b-5e58-471a-bf28-a4d5e6bf19e6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:30.165757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:30.203543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee003b-5e58-471a-bf28-a4d5e6bf19e6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:30.234747 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51c25f-0d96-4374-baa9-a2f2a96332b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:30.235348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51c25f-0d96-4374-baa9-a2f2a96332b0 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:30.235632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51c25f-0d96-4374-baa9-a2f2a96332b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:30.235899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51c25f-0d96-4374-baa9-a2f2a96332b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:30.246642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51c25f-0d96-4374-baa9-a2f2a96332b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8d51c25f-0d96-4374-baa9-a2f2a96332b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:30.251391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:30.252547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:30.253757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 576/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:30.258987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716a918-1cd2-4025-b590-e4a7f0b15ae7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:30.309792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:30.354956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716a918-1cd2-4025-b590-e4a7f0b15ae7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:30.387444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:30.388039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:30.388337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:30.388613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:30.389276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:30.389598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:30.390942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:30.398719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 574/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:08:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:30.404464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51c25f-0d96-4374-baa9-a2f2a96332b0 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:30.501166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51c25f-0d96-4374-baa9-a2f2a96332b0 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:30.523035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:30.533136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d3b35-f90a-4d57-8025-09b85d49b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:30.533743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3b35-f90a-4d57-8025-09b85d49b235 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:30.534023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3b35-f90a-4d57-8025-09b85d49b235 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:30.534297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3b35-f90a-4d57-8025-09b85d49b235 None admin] PATH_INFO: `/v3/users/6d815ecb03204069b5aa7a5479dfb4ce` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:30.535392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d3b35-f90a-4d57-8025-09b85d49b235 None admin] RBAC: Authorizing `identity:get_user(user_id=6d815ecb03204069b5aa7a5479dfb4ce)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:30.537676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d3b35-f90a-4d57-8025-09b85d49b235 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:30.541799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 577/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:30 2022] GET /identity/v3/users/6d815ecb03204069b5aa7a5479dfb4ce => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:30.544867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:30.641251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552b4ed-5999-4a08-b52c-63da9de4373f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:30.654151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:30.674183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648db2cf-7535-4262-9af9-4d3f44f81b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:30.674804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db2cf-7535-4262-9af9-4d3f44f81b82 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:30.675088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db2cf-7535-4262-9af9-4d3f44f81b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:30.675362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648db2cf-7535-4262-9af9-4d3f44f81b82 None admin] PATH_INFO: `/v3/projects/b47f48c664bc4a279774cbeaace2226a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:30.676521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db2cf-7535-4262-9af9-4d3f44f81b82 None admin] RBAC: Authorizing `identity:get_project(project_id=b47f48c664bc4a279774cbeaace2226a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:30.678675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648db2cf-7535-4262-9af9-4d3f44f81b82 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:30.680309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 575/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:30 2022] GET /identity/v3/projects/b47f48c664bc4a279774cbeaace2226a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:30.686150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d3b35-f90a-4d57-8025-09b85d49b235 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:30.782375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d3b35-f90a-4d57-8025-09b85d49b235 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:30.814473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2794cc-1250-4fe1-9929-8065e63efc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:30.815099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2794cc-1250-4fe1-9929-8065e63efc46 None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:30.815379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2794cc-1250-4fe1-9929-8065e63efc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:30.815651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2794cc-1250-4fe1-9929-8065e63efc46 None admin] PATH_INFO: `/v3/projects/b47f48c664bc4a279774cbeaace2226a/users/6d815ecb03204069b5aa7a5479dfb4ce/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:30.817510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2794cc-1250-4fe1-9929-8065e63efc46 None admin] RBAC: Authorizing `identity:create_grant(project_id=b47f48c664bc4a279774cbeaace2226a, user_id=6d815ecb03204069b5aa7a5479dfb4ce, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:30.819223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2794cc-1250-4fe1-9929-8065e63efc46 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:30.933967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 578/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:08:30 2022] PUT /identity/v3/projects/b47f48c664bc4a279774cbeaace2226a/users/6d815ecb03204069b5aa7a5479dfb4ce/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:08:32.799869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f277-876b-4d2c-99b6-fd2462d37bbd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:32.800427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f277-876b-4d2c-99b6-fd2462d37bbd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:32.800427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8f277-876b-4d2c-99b6-fd2462d37bbd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:32.801772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 576/1154] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:32.807518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f504a2-0a17-4acd-ac63-7047d93caddb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:32.807897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f504a2-0a17-4acd-ac63-7047d93caddb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:32.808073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f504a2-0a17-4acd-ac63-7047d93caddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:32.826998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d1f504a2-0a17-4acd-ac63-7047d93caddb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:32.828182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d1f504a2-0a17-4acd-ac63-7047d93caddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:32.874676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:32.893329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 579/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:33.168135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8f277-876b-4d2c-99b6-fd2462d37bbd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:33.266579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8f277-876b-4d2c-99b6-fd2462d37bbd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:33.299600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af278-2588-4761-a5fd-695feaf05e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:33.300214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af278-2588-4761-a5fd-695feaf05e07 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:33.300523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af278-2588-4761-a5fd-695feaf05e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:33.300796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af278-2588-4761-a5fd-695feaf05e07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:33.312279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0af278-2588-4761-a5fd-695feaf05e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-7f0af278-2588-4761-a5fd-695feaf05e07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:33.317080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:33.318920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:08:33.320160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 577/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:33.324807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f504a2-0a17-4acd-ac63-7047d93caddb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:33.423468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f504a2-0a17-4acd-ac63-7047d93caddb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:33.455908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:33.456529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:33.456811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:33.457084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:33.457742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:33.458097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:33.460055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:33.467785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 580/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:33.473470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af278-2588-4761-a5fd-695feaf05e07 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:33.515422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:33.569795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af278-2588-4761-a5fd-695feaf05e07 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:33.602168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4301b-6af3-4294-a1e8-5872d9dfd0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:33.602777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4301b-6af3-4294-a1e8-5872d9dfd0fc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:33.603054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4301b-6af3-4294-a1e8-5872d9dfd0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:33.603325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4301b-6af3-4294-a1e8-5872d9dfd0fc None admin] PATH_INFO: `/v3/users/6d815ecb03204069b5aa7a5479dfb4ce` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:33.604469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4301b-6af3-4294-a1e8-5872d9dfd0fc None admin] RBAC: Authorizing `identity:get_user(user_id=6d815ecb03204069b5aa7a5479dfb4ce)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:33.605905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4301b-6af3-4294-a1e8-5872d9dfd0fc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:33.607472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 578/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:33 2022] GET /identity/v3/users/6d815ecb03204069b5aa7a5479dfb4ce => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:33.613381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:33.658311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:33.712746 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743e205-cce6-4932-b1fc-cfc32b95b732 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:33.744696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e323c4-bce7-4c45-bd85-dcc7f10cbeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:33.745308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e323c4-bce7-4c45-bd85-dcc7f10cbeee None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:33.745585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e323c4-bce7-4c45-bd85-dcc7f10cbeee None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:33.745854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e323c4-bce7-4c45-bd85-dcc7f10cbeee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:33.809585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e323c4-bce7-4c45-bd85-dcc7f10cbeee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:33.811009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e323c4-bce7-4c45-bd85-dcc7f10cbeee None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:33.853245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:33.905322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 581/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:33.911537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4301b-6af3-4294-a1e8-5872d9dfd0fc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:34.006481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4301b-6af3-4294-a1e8-5872d9dfd0fc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:34.016049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:34.038934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6253d-d94f-42f2-9146-57309538530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:34.039548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6253d-d94f-42f2-9146-57309538530c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:34.039823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6253d-d94f-42f2-9146-57309538530c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:34.043966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6253d-d94f-42f2-9146-57309538530c None admin] PATH_INFO: `/v3/projects/b47f48c664bc4a279774cbeaace2226a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:34.043966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6253d-d94f-42f2-9146-57309538530c None admin] RBAC: Authorizing `identity:get_project(project_id=b47f48c664bc4a279774cbeaace2226a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:34.043966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6253d-d94f-42f2-9146-57309538530c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:34.044473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 579/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:33 2022] GET /identity/v3/projects/b47f48c664bc4a279774cbeaace2226a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:34.050292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e323c4-bce7-4c45-bd85-dcc7f10cbeee None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:34.145886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e323c4-bce7-4c45-bd85-dcc7f10cbeee None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:34.179106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ea404-cc62-4345-895c-3d8bbdf510d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:34.179684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ea404-cc62-4345-895c-3d8bbdf510d2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:34.179961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ea404-cc62-4345-895c-3d8bbdf510d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:34.180228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ea404-cc62-4345-895c-3d8bbdf510d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:34.180966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ea404-cc62-4345-895c-3d8bbdf510d2 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=b47f48c664bc4a279774cbeaace2226a, user.id=6d815ecb03204069b5aa7a5479dfb4ce) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:34.181267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ea404-cc62-4345-895c-3d8bbdf510d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:34.182662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ea404-cc62-4345-895c-3d8bbdf510d2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:34.188176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 582/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:34 2022] GET /identity/v3/role_assignments?user.id=6d815ecb03204069b5aa7a5479dfb4ce&scope.project.id=b47f48c664bc4a279774cbeaace2226a&role.id=fe95a036fa044c4bb408b793fba6436a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:36.093674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d9bea-3c5f-4b8c-8cb0-65d7c037bffd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:36.094196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d9bea-3c5f-4b8c-8cb0-65d7c037bffd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:36.094196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d9bea-3c5f-4b8c-8cb0-65d7c037bffd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:36.095515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 580/1162] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:36.101215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a370ac0-ed15-4c32-9a9e-f569a08ed2ff None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:36.101657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a370ac0-ed15-4c32-9a9e-f569a08ed2ff None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:36.101759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a370ac0-ed15-4c32-9a9e-f569a08ed2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:36.119214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9a370ac0-ed15-4c32-9a9e-f569a08ed2ff None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:36.120423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9a370ac0-ed15-4c32-9a9e-f569a08ed2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:36.122330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:36.186754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 583/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:36.459522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d9bea-3c5f-4b8c-8cb0-65d7c037bffd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:36.557369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d9bea-3c5f-4b8c-8cb0-65d7c037bffd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:36.590270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36181264-7762-41c8-ad8a-184cfd98e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:36.590857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181264-7762-41c8-ad8a-184cfd98e79a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:36.591136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181264-7762-41c8-ad8a-184cfd98e79a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:36.591408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36181264-7762-41c8-ad8a-184cfd98e79a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:36.635736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:36.656757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36181264-7762-41c8-ad8a-184cfd98e79a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:36.658208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36181264-7762-41c8-ad8a-184cfd98e79a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:36.753930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 581/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:36.760559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a370ac0-ed15-4c32-9a9e-f569a08ed2ff None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:36.856434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a370ac0-ed15-4c32-9a9e-f569a08ed2ff None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:36.889863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8986f21-92ae-4a1a-85de-fa7ee2dbf12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:36.890481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8986f21-92ae-4a1a-85de-fa7ee2dbf12e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:36.890757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8986f21-92ae-4a1a-85de-fa7ee2dbf12e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:36.891024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8986f21-92ae-4a1a-85de-fa7ee2dbf12e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:36.897799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8986f21-92ae-4a1a-85de-fa7ee2dbf12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:36.899224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8986f21-92ae-4a1a-85de-fa7ee2dbf12e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:36.900957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e8986f21-92ae-4a1a-85de-fa7ee2dbf12e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:36.910778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:36.912195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:36.917842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 584/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:08:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:36.918872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36181264-7762-41c8-ad8a-184cfd98e79a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:36.993773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:37.014807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36181264-7762-41c8-ad8a-184cfd98e79a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:37.047999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23e181-7064-40c7-8b43-615890a14784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:37.048612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e181-7064-40c7-8b43-615890a14784 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:37.048888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e181-7064-40c7-8b43-615890a14784 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:37.049153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23e181-7064-40c7-8b43-615890a14784 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:37.049789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23e181-7064-40c7-8b43-615890a14784 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:37.050085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23e181-7064-40c7-8b43-615890a14784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:37.051433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23e181-7064-40c7-8b43-615890a14784 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:37.059230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 582/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 28 10:08:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:38.947585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446474-2685-44bc-97b0-793a5e52cbef None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:38.948100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446474-2685-44bc-97b0-793a5e52cbef None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:38.948100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de446474-2685-44bc-97b0-793a5e52cbef None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:38.949503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 585/1167] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:38.954846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2f0d3-202e-44e6-b127-737f8da8aeaf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:38.955229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2f0d3-202e-44e6-b127-737f8da8aeaf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:38.955397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2f0d3-202e-44e6-b127-737f8da8aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:38.973503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f9d2f0d3-202e-44e6-b127-737f8da8aeaf None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:38.975225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f9d2f0d3-202e-44e6-b127-737f8da8aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:39.039664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 583/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:39.310931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de446474-2685-44bc-97b0-793a5e52cbef None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:39.411979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de446474-2685-44bc-97b0-793a5e52cbef None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:39.444045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa7bb5-4c83-46ba-a10d-34b7d9f0c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:39.444649 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7bb5-4c83-46ba-a10d-34b7d9f0c302 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:39.444924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7bb5-4c83-46ba-a10d-34b7d9f0c302 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:39.445192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7bb5-4c83-46ba-a10d-34b7d9f0c302 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:39.445853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa7bb5-4c83-46ba-a10d-34b7d9f0c302 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:39.447194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa7bb5-4c83-46ba-a10d-34b7d9f0c302 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:39.510796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 586/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Sun Aug 28 10:08:39 2022] POST /identity/v3/domains => generated 267 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:08:41.418486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cedfaa-6d91-477a-869b-e0775ed305b6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:41.419021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cedfaa-6d91-477a-869b-e0775ed305b6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:41.419021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cedfaa-6d91-477a-869b-e0775ed305b6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:41.420407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 584/1170] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:41.425563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e931be-1e3b-4dec-9471-9a7ef304ab84 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:41.425991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e931be-1e3b-4dec-9471-9a7ef304ab84 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:41.426119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e931be-1e3b-4dec-9471-9a7ef304ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:41.443725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c5e931be-1e3b-4dec-9471-9a7ef304ab84 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:41.444941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c5e931be-1e3b-4dec-9471-9a7ef304ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:41.496553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:41.509485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 587/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:41.786768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cedfaa-6d91-477a-869b-e0775ed305b6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:41.855877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:41.885300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cedfaa-6d91-477a-869b-e0775ed305b6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:41.918303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d8bd5-ed22-414f-840d-ca24fe3fd5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:41.918920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8bd5-ed22-414f-840d-ca24fe3fd5fd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:41.919201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8bd5-ed22-414f-840d-ca24fe3fd5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:41.919475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8bd5-ed22-414f-840d-ca24fe3fd5fd None admin] PATH_INFO: `/v3/domains/21c5eb0f0d52410da31e39fef9107270` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:41.930683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d8bd5-ed22-414f-840d-ca24fe3fd5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=21c5eb0f0d52410da31e39fef9107270)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:41.932130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d8bd5-ed22-414f-840d-ca24fe3fd5fd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:41.933745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 585/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Aug 28 10:08:41 2022] GET /identity/v3/domains/21c5eb0f0d52410da31e39fef9107270 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:41.939459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e931be-1e3b-4dec-9471-9a7ef304ab84 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:42.033912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e931be-1e3b-4dec-9471-9a7ef304ab84 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:42.066856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bbcc2c-01ff-4dce-b26d-ed6ef291ddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:42.068069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbcc2c-01ff-4dce-b26d-ed6ef291ddb6 None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:42.068334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbcc2c-01ff-4dce-b26d-ed6ef291ddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:42.068613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bbcc2c-01ff-4dce-b26d-ed6ef291ddb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:42.069274 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbcc2c-01ff-4dce-b26d-ed6ef291ddb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:42.070698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bbcc2c-01ff-4dce-b26d-ed6ef291ddb6 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:42.150980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 588/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:08:41 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:08:44.084573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ccf6-7057-487c-8b51-ae97bcf303a5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:44.085166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ccf6-7057-487c-8b51-ae97bcf303a5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:44.085166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051ccf6-7057-487c-8b51-ae97bcf303a5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:44.086431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 586/1174] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:44.091757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140d95c-a41f-48c1-96d9-6997a4e02ae9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:44.092132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140d95c-a41f-48c1-96d9-6997a4e02ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:44.092318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140d95c-a41f-48c1-96d9-6997a4e02ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:44.110318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6140d95c-a41f-48c1-96d9-6997a4e02ae9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:44.111479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6140d95c-a41f-48c1-96d9-6997a4e02ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:44.144503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:44.175827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 589/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:44.440044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051ccf6-7057-487c-8b51-ae97bcf303a5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:44.538662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051ccf6-7057-487c-8b51-ae97bcf303a5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:44.566015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:44.571314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028caa10-8184-4132-9011-7fa98561c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:44.571927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028caa10-8184-4132-9011-7fa98561c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:44.572205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028caa10-8184-4132-9011-7fa98561c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:44.572504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028caa10-8184-4132-9011-7fa98561c5a9 None admin] PATH_INFO: `/v3/domains/21c5eb0f0d52410da31e39fef9107270` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:44.573605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028caa10-8184-4132-9011-7fa98561c5a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=21c5eb0f0d52410da31e39fef9107270)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:44.575032 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028caa10-8184-4132-9011-7fa98561c5a9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:44.576610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 587/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Aug 28 10:08:44 2022] GET /identity/v3/domains/21c5eb0f0d52410da31e39fef9107270 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:44.582216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140d95c-a41f-48c1-96d9-6997a4e02ae9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:44.678454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140d95c-a41f-48c1-96d9-6997a4e02ae9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:44.711132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea3ec9-a910-421f-b7de-41eb8f50dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:44.711659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3ec9-a910-421f-b7de-41eb8f50dbba None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:44.711934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3ec9-a910-421f-b7de-41eb8f50dbba None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:44.712201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea3ec9-a910-421f-b7de-41eb8f50dbba None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:44.712886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea3ec9-a910-421f-b7de-41eb8f50dbba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:44.714312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea3ec9-a910-421f-b7de-41eb8f50dbba None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:44.806330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 590/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:08:44 2022] POST /identity/v3/users => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:08:46.755375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1cc8-7838-4d1f-80f1-99c9cc576ab0 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:46.756028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1cc8-7838-4d1f-80f1-99c9cc576ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:46.756028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1cc8-7838-4d1f-80f1-99c9cc576ab0 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:46.757516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 588/1178] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:46.762645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e903af-1f20-4287-8def-7da08b876d27 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:46.763092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e903af-1f20-4287-8def-7da08b876d27 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:46.763199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e903af-1f20-4287-8def-7da08b876d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:46.781054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b9e903af-1f20-4287-8def-7da08b876d27 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:46.782220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b9e903af-1f20-4287-8def-7da08b876d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:46.802339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:46.847558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 591/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:08:47.116058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1cc8-7838-4d1f-80f1-99c9cc576ab0 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:47.214729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1cc8-7838-4d1f-80f1-99c9cc576ab0 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:47.247377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8935dc8-f475-4d7b-a042-5de04c02f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:47.247988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8935dc8-f475-4d7b-a042-5de04c02f5ea None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:47.248268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8935dc8-f475-4d7b-a042-5de04c02f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:47.248572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8935dc8-f475-4d7b-a042-5de04c02f5ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:47.258963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8935dc8-f475-4d7b-a042-5de04c02f5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f8935dc8-f475-4d7b-a042-5de04c02f5ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:47.263734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:47.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:08:47.266030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 589/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:47.270717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e903af-1f20-4287-8def-7da08b876d27 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:47.365568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e903af-1f20-4287-8def-7da08b876d27 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:47.398128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:47.398656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:47.398932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:47.399200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:47.399849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:47.400151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:47.401529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:47.409251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 592/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:08:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:47.415450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8935dc8-f475-4d7b-a042-5de04c02f5ea None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:47.473772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:47.513369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8935dc8-f475-4d7b-a042-5de04c02f5ea None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:47.545240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15132e-bdc8-4c4c-9d0b-699f5cff0f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:47.545850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15132e-bdc8-4c4c-9d0b-699f5cff0f0b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:47.546126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15132e-bdc8-4c4c-9d0b-699f5cff0f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:47.546397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15132e-bdc8-4c4c-9d0b-699f5cff0f0b None admin] PATH_INFO: `/v3/users/20fd74adf6b3488fa64efaf52668921a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:47.559473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15132e-bdc8-4c4c-9d0b-699f5cff0f0b None admin] RBAC: Authorizing `identity:get_user(user_id=20fd74adf6b3488fa64efaf52668921a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:47.560949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15132e-bdc8-4c4c-9d0b-699f5cff0f0b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:47.562519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 590/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:47 2022] GET /identity/v3/users/20fd74adf6b3488fa64efaf52668921a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:47.568383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:47.586948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:47.664686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adb9bd-6f34-4420-af9b-8d70e6dfe8a1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:47.696770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dd014-fbc8-4dc3-a449-8df656f7cf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:47.697357 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dd014-fbc8-4dc3-a449-8df656f7cf8d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:47.697634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dd014-fbc8-4dc3-a449-8df656f7cf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:47.697903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dd014-fbc8-4dc3-a449-8df656f7cf8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:47.761223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dd014-fbc8-4dc3-a449-8df656f7cf8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:47.762641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dd014-fbc8-4dc3-a449-8df656f7cf8d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:47.779212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:47.859795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 593/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:47.866347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15132e-bdc8-4c4c-9d0b-699f5cff0f0b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:47.962253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15132e-bdc8-4c4c-9d0b-699f5cff0f0b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:47.979202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:47.995267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e70d5-dfcc-4fef-a847-54ca4a22ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:47.995883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e70d5-dfcc-4fef-a847-54ca4a22ba52 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:47.996165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e70d5-dfcc-4fef-a847-54ca4a22ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:47.996476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e70d5-dfcc-4fef-a847-54ca4a22ba52 None admin] PATH_INFO: `/v3/projects/87c02ebc86b947fe810c64d6b5383370` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:47.997600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e70d5-dfcc-4fef-a847-54ca4a22ba52 None admin] RBAC: Authorizing `identity:get_project(project_id=87c02ebc86b947fe810c64d6b5383370)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:47.999028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e70d5-dfcc-4fef-a847-54ca4a22ba52 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:48.000670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 591/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:47 2022] GET /identity/v3/projects/87c02ebc86b947fe810c64d6b5383370 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:48.006716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dd014-fbc8-4dc3-a449-8df656f7cf8d None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:48.103343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dd014-fbc8-4dc3-a449-8df656f7cf8d None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:48.119176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:48.135170 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d5633-4682-413c-8462-4779463ba00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:48.135761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d5633-4682-413c-8462-4779463ba00b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:48.136039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d5633-4682-413c-8462-4779463ba00b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:48.136429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d5633-4682-413c-8462-4779463ba00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:48.137153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d5633-4682-413c-8462-4779463ba00b None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=87c02ebc86b947fe810c64d6b5383370, user.id=20fd74adf6b3488fa64efaf52668921a) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:48.137460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d5633-4682-413c-8462-4779463ba00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:48.138859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d5633-4682-413c-8462-4779463ba00b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:48.144330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 594/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:48 2022] GET /identity/v3/role_assignments?user.id=20fd74adf6b3488fa64efaf52668921a&scope.project.id=87c02ebc86b947fe810c64d6b5383370&role.id=fe95a036fa044c4bb408b793fba6436a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:50.008895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1c708-f4a8-4581-8e41-25a339f41300 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:50.009442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1c708-f4a8-4581-8e41-25a339f41300 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:50.009442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1c708-f4a8-4581-8e41-25a339f41300 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:50.010785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 592/1186] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:50.015849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be560f-fd6c-4a02-8214-4fababf21c28 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:50.016270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be560f-fd6c-4a02-8214-4fababf21c28 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:50.016433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be560f-fd6c-4a02-8214-4fababf21c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:50.034709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-44be560f-fd6c-4a02-8214-4fababf21c28 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:50.036401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-44be560f-fd6c-4a02-8214-4fababf21c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:50.101291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 595/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:50.371638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1c708-f4a8-4581-8e41-25a339f41300 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:50.468927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1c708-f4a8-4581-8e41-25a339f41300 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:50.501618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45a35c-0000-431b-8dd5-0dc9c96cd526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:50.502220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45a35c-0000-431b-8dd5-0dc9c96cd526 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:50.502496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45a35c-0000-431b-8dd5-0dc9c96cd526 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:50.502763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45a35c-0000-431b-8dd5-0dc9c96cd526 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:50.513112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45a35c-0000-431b-8dd5-0dc9c96cd526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3c45a35c-0000-431b-8dd5-0dc9c96cd526 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:50.517811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:50.518928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:08:50.520064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 593/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:50.525193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be560f-fd6c-4a02-8214-4fababf21c28 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:50.620089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be560f-fd6c-4a02-8214-4fababf21c28 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:50.632631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:50.652464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:50.655952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:50.655952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:50.655952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:50.655952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:50.655952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:50.655952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:50.664113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 596/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:50.669846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45a35c-0000-431b-8dd5-0dc9c96cd526 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:50.715050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:50.766210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45a35c-0000-431b-8dd5-0dc9c96cd526 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:50.797897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7795ea-4c2c-400e-81cd-097cf2b1b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:50.798503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7795ea-4c2c-400e-81cd-097cf2b1b069 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:50.798777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7795ea-4c2c-400e-81cd-097cf2b1b069 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:50.799046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7795ea-4c2c-400e-81cd-097cf2b1b069 None admin] PATH_INFO: `/v3/users/20fd74adf6b3488fa64efaf52668921a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:50.800142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7795ea-4c2c-400e-81cd-097cf2b1b069 None admin] RBAC: Authorizing `identity:get_user(user_id=20fd74adf6b3488fa64efaf52668921a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:50.802197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7795ea-4c2c-400e-81cd-097cf2b1b069 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:50.803734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 594/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:50 2022] GET /identity/v3/users/20fd74adf6b3488fa64efaf52668921a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:50.809373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:50.909935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4337-18d3-47a7-95ba-411a95f07cb1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:50.943155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbbd1c-d79b-4319-b137-f77f8ed9a98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:50.943764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbbd1c-d79b-4319-b137-f77f8ed9a98d None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:50.944042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbbd1c-d79b-4319-b137-f77f8ed9a98d None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:50.944333 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbbd1c-d79b-4319-b137-f77f8ed9a98d None admin] PATH_INFO: `/v3/projects/87c02ebc86b947fe810c64d6b5383370` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:50.945540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbbd1c-d79b-4319-b137-f77f8ed9a98d None admin] RBAC: Authorizing `identity:get_project(project_id=87c02ebc86b947fe810c64d6b5383370)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:50.947017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbbd1c-d79b-4319-b137-f77f8ed9a98d None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:50.948708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 597/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:50 2022] GET /identity/v3/projects/87c02ebc86b947fe810c64d6b5383370 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:50.954632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7795ea-4c2c-400e-81cd-097cf2b1b069 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:51.052567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7795ea-4c2c-400e-81cd-097cf2b1b069 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:51.065583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:51.085439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6b689-9675-46e8-bd71-9967d38d76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:51.086085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6b689-9675-46e8-bd71-9967d38d76c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:51.086365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6b689-9675-46e8-bd71-9967d38d76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:51.086637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6b689-9675-46e8-bd71-9967d38d76c1 None admin] PATH_INFO: `/v3/projects/87c02ebc86b947fe810c64d6b5383370/users/20fd74adf6b3488fa64efaf52668921a/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:51.088568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6b689-9675-46e8-bd71-9967d38d76c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=87c02ebc86b947fe810c64d6b5383370, user_id=20fd74adf6b3488fa64efaf52668921a, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:51.090007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6b689-9675-46e8-bd71-9967d38d76c1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:51.177950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 595/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:08:50 2022] PUT /identity/v3/projects/87c02ebc86b947fe810c64d6b5383370/users/20fd74adf6b3488fa64efaf52668921a/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:08:53.051398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc09d90-dff5-4afb-b420-a4ecbd4a94de None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:53.051939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc09d90-dff5-4afb-b420-a4ecbd4a94de None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:53.051939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc09d90-dff5-4afb-b420-a4ecbd4a94de None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:53.053321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 598/1193] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:08:53.058507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a29f13-f2d9-47c2-8470-3674f77ec234 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:53.058913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a29f13-f2d9-47c2-8470-3674f77ec234 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:53.059066 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a29f13-f2d9-47c2-8470-3674f77ec234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:53.077322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-83a29f13-f2d9-47c2-8470-3674f77ec234 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:08:53.078496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-83a29f13-f2d9-47c2-8470-3674f77ec234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:08:53.142050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 596/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:08:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:08:53.410923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc09d90-dff5-4afb-b420-a4ecbd4a94de None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:53.454591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:53.510111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc09d90-dff5-4afb-b420-a4ecbd4a94de None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:53.551664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bc9d-d1ef-4432-b0d7-ad682e20c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:53.551664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bc9d-d1ef-4432-b0d7-ad682e20c460 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:53.551664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bc9d-d1ef-4432-b0d7-ad682e20c460 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:53.551664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bc9d-d1ef-4432-b0d7-ad682e20c460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:53.553944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223bc9d-d1ef-4432-b0d7-ad682e20c460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-8223bc9d-d1ef-4432-b0d7-ad682e20c460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:08:53.558690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:08:53.559812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:08:53.561055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 599/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:08:53.565782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a29f13-f2d9-47c2-8470-3674f77ec234 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:53.661991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a29f13-f2d9-47c2-8470-3674f77ec234 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:53.664138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:53.694644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:53.695239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:53.695516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:53.695783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:53.696477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:53.696879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:53.698402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:53.706757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 597/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:08:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:53.712785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bc9d-d1ef-4432-b0d7-ad682e20c460 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:53.810316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bc9d-d1ef-4432-b0d7-ad682e20c460 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:53.811820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:53.843852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827846e-3d4c-4399-9c8f-32d9eb07b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:53.844507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827846e-3d4c-4399-9c8f-32d9eb07b4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:53.844785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827846e-3d4c-4399-9c8f-32d9eb07b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:53.845054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827846e-3d4c-4399-9c8f-32d9eb07b4a5 None admin] PATH_INFO: `/v3/users/20fd74adf6b3488fa64efaf52668921a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:53.846151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827846e-3d4c-4399-9c8f-32d9eb07b4a5 None admin] RBAC: Authorizing `identity:get_user(user_id=20fd74adf6b3488fa64efaf52668921a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:53.847567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827846e-3d4c-4399-9c8f-32d9eb07b4a5 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:53.850014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 600/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 28 10:08:53 2022] GET /identity/v3/users/20fd74adf6b3488fa64efaf52668921a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:53.855943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:53.952223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d40d1-b9a0-46a3-bc05-a49faeab6572 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:53.984634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97562a-e381-4f66-ae93-435fc3078ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:53.985222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97562a-e381-4f66-ae93-435fc3078ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:53.985503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97562a-e381-4f66-ae93-435fc3078ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:53.985775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97562a-e381-4f66-ae93-435fc3078ed5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:54.017000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:54.050699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97562a-e381-4f66-ae93-435fc3078ed5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:54.052207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97562a-e381-4f66-ae93-435fc3078ed5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:54.145790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 598/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:08:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:08:54.151677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827846e-3d4c-4399-9c8f-32d9eb07b4a5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:54.247526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827846e-3d4c-4399-9c8f-32d9eb07b4a5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:54.279984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85e0b5-3218-4a00-b9e5-3a0942b92273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:54.280619 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85e0b5-3218-4a00-b9e5-3a0942b92273 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:54.280900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85e0b5-3218-4a00-b9e5-3a0942b92273 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:54.281170 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85e0b5-3218-4a00-b9e5-3a0942b92273 None admin] PATH_INFO: `/v3/projects/87c02ebc86b947fe810c64d6b5383370` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:54.282267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85e0b5-3218-4a00-b9e5-3a0942b92273 None admin] RBAC: Authorizing `identity:get_project(project_id=87c02ebc86b947fe810c64d6b5383370)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:54.283674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85e0b5-3218-4a00-b9e5-3a0942b92273 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:54.285879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 601/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 28 10:08:54 2022] GET /identity/v3/projects/87c02ebc86b947fe810c64d6b5383370 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:08:54.291810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97562a-e381-4f66-ae93-435fc3078ed5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:08:54.353686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:08:54.386698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97562a-e381-4f66-ae93-435fc3078ed5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:08:54.419434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79512d0e-ff94-401c-82d7-dd4a86c2a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:08:54.420025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512d0e-ff94-401c-82d7-dd4a86c2a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:08:54.420325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512d0e-ff94-401c-82d7-dd4a86c2a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:08:54.420602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79512d0e-ff94-401c-82d7-dd4a86c2a8c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:08:54.421326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79512d0e-ff94-401c-82d7-dd4a86c2a8c4 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=87c02ebc86b947fe810c64d6b5383370, user.id=20fd74adf6b3488fa64efaf52668921a) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:08:54.421629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79512d0e-ff94-401c-82d7-dd4a86c2a8c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:08:54.423049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79512d0e-ff94-401c-82d7-dd4a86c2a8c4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:08:54.428598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 599/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:08:54 2022] GET /identity/v3/role_assignments?user.id=20fd74adf6b3488fa64efaf52668921a&scope.project.id=87c02ebc86b947fe810c64d6b5383370&role.id=fe95a036fa044c4bb408b793fba6436a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:09:04.275961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:09:04.426498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=35 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:04.973733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833053b-5791-439b-8237-709f9e2ebdf8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:04.974313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833053b-5791-439b-8237-709f9e2ebdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:04.974648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833053b-5791-439b-8237-709f9e2ebdf8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:04.976030 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 602/1201] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:04.981226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f3a39-90d2-4804-a495-839718471dde None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:04.981681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f3a39-90d2-4804-a495-839718471dde None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:04.981794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f3a39-90d2-4804-a495-839718471dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:05.000438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-136f3a39-90d2-4804-a495-839718471dde None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:05.002484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-136f3a39-90d2-4804-a495-839718471dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:05.075997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 600/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:10:05.343732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833053b-5791-439b-8237-709f9e2ebdf8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:05.447285 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833053b-5791-439b-8237-709f9e2ebdf8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:05.481095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:05.481714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:05.481997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:05.482273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:05.492999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:05.494473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:05.509005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:05.510216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:05.511289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:05.511289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:05.511289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:05.511289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 603/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:05.517285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f3a39-90d2-4804-a495-839718471dde None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:05.614043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f3a39-90d2-4804-a495-839718471dde None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:05.641895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:05.650201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed6bb0-2e0f-4907-b532-fe79356adce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:05.650201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed6bb0-2e0f-4907-b532-fe79356adce4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:05.650201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed6bb0-2e0f-4907-b532-fe79356adce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:05.650201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed6bb0-2e0f-4907-b532-fe79356adce4 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:05.650578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed6bb0-2e0f-4907-b532-fe79356adce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:05.650578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed6bb0-2e0f-4907-b532-fe79356adce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:05.651174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed6bb0-2e0f-4907-b532-fe79356adce4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:05.662937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 601/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:05.668779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:05.721270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:05.767474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff84d7-329e-4e2e-a885-ab77aa645784 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:05.801129 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31d5ac-a0eb-498e-ac44-e9f96d9b20ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:05.801738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d5ac-a0eb-498e-ac44-e9f96d9b20ec None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:05.802560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d5ac-a0eb-498e-ac44-e9f96d9b20ec None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:05.802842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d5ac-a0eb-498e-ac44-e9f96d9b20ec None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:05.803567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31d5ac-a0eb-498e-ac44-e9f96d9b20ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:05.805086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31d5ac-a0eb-498e-ac44-e9f96d9b20ec None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:05.919071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 604/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 28 10:10:05 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:10:07.854892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6796be-9b55-4a86-a306-d0ecaeb34243 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:07.855495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6796be-9b55-4a86-a306-d0ecaeb34243 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:07.855495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6796be-9b55-4a86-a306-d0ecaeb34243 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:07.856861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 602/1206] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:07.862099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd203e-05ff-49bd-b651-217ef01888f3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:07.862521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd203e-05ff-49bd-b651-217ef01888f3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:07.862651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd203e-05ff-49bd-b651-217ef01888f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:07.881405 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0ecd203e-05ff-49bd-b651-217ef01888f3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:07.883323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0ecd203e-05ff-49bd-b651-217ef01888f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:07.947756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 605/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:10:08.220651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6796be-9b55-4a86-a306-d0ecaeb34243 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:08.322222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6796be-9b55-4a86-a306-d0ecaeb34243 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:08.354831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fc5ec-86b2-4c24-b060-2ac2a9318edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:08.355449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fc5ec-86b2-4c24-b060-2ac2a9318edb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:08.355725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fc5ec-86b2-4c24-b060-2ac2a9318edb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:08.355993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fc5ec-86b2-4c24-b060-2ac2a9318edb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:08.366375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fc5ec-86b2-4c24-b060-2ac2a9318edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f69fc5ec-86b2-4c24-b060-2ac2a9318edb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:10:08.371176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:08.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:08.373490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 603/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:10:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:08.378176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd203e-05ff-49bd-b651-217ef01888f3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:08.416730 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:08.473008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd203e-05ff-49bd-b651-217ef01888f3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:08.506548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:08.507147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:08.507428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:08.507709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:08.508388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:08.508691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:08.510048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:08.517666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 606/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:10:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:08.523468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fc5ec-86b2-4c24-b060-2ac2a9318edb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:08.574641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:08.622704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fc5ec-86b2-4c24-b060-2ac2a9318edb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:08.655149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:08.655771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:08.656049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:08.656346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:08.667471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:08.668991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:08.683025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:08.684166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:08.685524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:08.685524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:08.685524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:08.685524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 604/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:08.690025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:08.787025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:08.789856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92244072-7f8c-4e2a-8be9-db0a94a4c25c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:08.823513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:08.824257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:08.824571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:08.824850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:08.825505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:08.825812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:08.827262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:08.839720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 607/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:08.845426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:08.947075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050bc9f-e8d9-4c48-9912-c1df593949db None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:08.948682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:08.981986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:08.982605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:08.982916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:08.983172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:08.990014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:08.991471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:10:09.002661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:09.005180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:09.006180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 605/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:09.009724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:09.111178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5108-4a03-4fff-b931-d8c88c9a79e8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:09.144383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:09.144989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:09.145267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:09.146034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:09.146838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:09.147081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:09.148528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:09.166090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 608/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 10:10:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:09.172000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:09.271243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6ea86-380e-489a-b2d7-75d26a6364ec None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:09.304120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86e7e2-6090-411c-a35c-19986c294a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:09.304752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86e7e2-6090-411c-a35c-19986c294a96 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:09.305032 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86e7e2-6090-411c-a35c-19986c294a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:09.305305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86e7e2-6090-411c-a35c-19986c294a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:09.335217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:09.371571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86e7e2-6090-411c-a35c-19986c294a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:09.372984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86e7e2-6090-411c-a35c-19986c294a96 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:09.469150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 606/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:10:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:10:09.475151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:09.493602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:09.572592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ad055-9665-46af-ab91-e0cf64e71b6c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:09.605435 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:09.606050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:09.606325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:09.606593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:09.616918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:09.618382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:09.633603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:09.634804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:09.635956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:09.635956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:09.635956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:09.635956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 609/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:10:09.640570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86e7e2-6090-411c-a35c-19986c294a96 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:09.700327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:09.738662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86e7e2-6090-411c-a35c-19986c294a96 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:09.774126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:09.774818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:09.775056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:09.775330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:09.775980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:09.776282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:09.777692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:09.789522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 607/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:09.795246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:09.863949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:09.894425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36338-124e-4d47-8184-f92685a3a5a8 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:09.928011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:09.928661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:09.928940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:09.929202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:09.935865 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:09.937395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:10:09.949920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:09.950867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:09.953230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 610/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:10:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:09.957227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:10.058720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2745-b6c5-4bfd-9205-b50b3150c79c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:10.081565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:10.092926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ddd1f-69b3-41a3-a1c5-d74198007a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:10.093529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ddd1f-69b3-41a3-a1c5-d74198007a82 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:10.093807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ddd1f-69b3-41a3-a1c5-d74198007a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:10.094078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ddd1f-69b3-41a3-a1c5-d74198007a82 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:10.094766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ddd1f-69b3-41a3-a1c5-d74198007a82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:10.095116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ddd1f-69b3-41a3-a1c5-d74198007a82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:10.096601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ddd1f-69b3-41a3-a1c5-d74198007a82 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:10.108568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 608/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:10:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:10.115469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:10.218342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9493b-fbd3-4389-a993-45de9bb2c93b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:10.246999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:10.252243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a3aa1-66cb-4c27-b4a1-7c073b8ee8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:10.252859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a3aa1-66cb-4c27-b4a1-7c073b8ee8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:10.253135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a3aa1-66cb-4c27-b4a1-7c073b8ee8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:10.253430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a3aa1-66cb-4c27-b4a1-7c073b8ee8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:10.254180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a3aa1-66cb-4c27-b4a1-7c073b8ee8e4 None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=d36276f9c3f840e881d15ece72a94d07) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:10.254486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a3aa1-66cb-4c27-b4a1-7c073b8ee8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:10.256252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a3aa1-66cb-4c27-b4a1-7c073b8ee8e4 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:10.261420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 611/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:10:10 2022] GET /identity/v3/role_assignments?user.id=d36276f9c3f840e881d15ece72a94d07&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:12.135893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804319d-e9c3-4d74-b384-80772f6e6662 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:12.136455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804319d-e9c3-4d74-b384-80772f6e6662 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:12.136455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804319d-e9c3-4d74-b384-80772f6e6662 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:12.137807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 609/1220] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:12.142930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ade8-c2ce-4ca7-9ce8-cf04491eddd0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:12.143371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ade8-c2ce-4ca7-9ce8-cf04491eddd0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:12.143474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ade8-c2ce-4ca7-9ce8-cf04491eddd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:12.162759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-baa0ade8-c2ce-4ca7-9ce8-cf04491eddd0 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:12.163968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-baa0ade8-c2ce-4ca7-9ce8-cf04491eddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:12.227581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 612/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:10:12.498148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804319d-e9c3-4d74-b384-80772f6e6662 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:12.598857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804319d-e9c3-4d74-b384-80772f6e6662 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:12.632781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c7ab-6bd5-4639-b9c8-253e4ae8e0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:12.633400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c7ab-6bd5-4639-b9c8-253e4ae8e0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:12.633678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c7ab-6bd5-4639-b9c8-253e4ae8e0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:12.633944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c7ab-6bd5-4639-b9c8-253e4ae8e0a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:12.644008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c7ab-6bd5-4639-b9c8-253e4ae8e0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-9955c7ab-6bd5-4639-b9c8-253e4ae8e0a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:10:12.649185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:12.650446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:12.651674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 610/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:10:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:12.656396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0ade8-c2ce-4ca7-9ce8-cf04491eddd0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:12.754037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0ade8-c2ce-4ca7-9ce8-cf04491eddd0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:12.777042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:12.787511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:12.788110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:12.788420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:12.788696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:12.789355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] RBAC: Adding query filter params (name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:12.789655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:12.791006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:12.798813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 613/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:10:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:12.805069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c7ab-6bd5-4639-b9c8-253e4ae8e0a7 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:12.850018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:12.905388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c7ab-6bd5-4639-b9c8-253e4ae8e0a7 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:12.939901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:12.940571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:12.940848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:12.941116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:12.951574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:12.953076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:12.967377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:12.968539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:12.969711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:12.969711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:12.969711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:12.969711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 611/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:12.975297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:13.075716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76bc74-970c-430d-9a52-15ca9bc2870c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:13.108901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:13.109491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:13.109769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:13.110041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:13.110670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:13.110970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:13.112334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:13.124944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 614/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:10:13.131005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:13.224778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:13.231192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d55c-99c1-49db-a2a0-3f8308b18cd5 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:13.264353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:13.264974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:13.265250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:13.265519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:13.273696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:13.275168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:10:13.288202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:13.289594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:13.290813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 612/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:10:13.295345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:13.342356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:13.393823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b389f-1701-4e06-bce7-df00bb3aa984 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:13.428319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:13.428916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:13.429197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:13.429471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:13.430192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:13.430496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:13.431980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:13.449451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 615/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 10:10:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:13.455418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:13.554955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de88a-bd58-4746-b27f-4d41a7b5cdbd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:13.588122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:13.588776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:13.589053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:13.589321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:13.602290 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:13.602290 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:13.615803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:13.616961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:13.618069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:13.618069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:13.618069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:13.618069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 613/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:13.623038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:13.723555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02f7ba-24a5-49e2-a100-7e0a629c567e None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:13.726050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:13.757504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:13.758097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:13.758372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:13.758641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:13.759273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:13.759579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:13.760953 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:13.772672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 616/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:13.778426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:13.788368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:13.881400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf895a9f-23c3-4840-b702-b3d17e4928e9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:13.914431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:13.915057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:13.915338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:13.915613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:13.922070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:13.923504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:10:13.934449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:13.935506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:13.936669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 614/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:10:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:13.941580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:14.040531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4579c6-35a3-4e41-ae25-34596a27972f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:14.074087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf8e5-54fa-4131-a7a3-2a4e4a7740e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:14.074673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf8e5-54fa-4131-a7a3-2a4e4a7740e2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:14.074943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf8e5-54fa-4131-a7a3-2a4e4a7740e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:14.075208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf8e5-54fa-4131-a7a3-2a4e4a7740e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:14.075896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf8e5-54fa-4131-a7a3-2a4e4a7740e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:14.076190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf8e5-54fa-4131-a7a3-2a4e4a7740e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:14.077624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf8e5-54fa-4131-a7a3-2a4e4a7740e2 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:14.089704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 617/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:10:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:14.095870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:14.160329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:14.194028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf1a9-32df-4a7b-b553-d20d1de66490 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:14.225819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f8a20-3bab-4221-a4bc-c388ce388a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:14.226457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8a20-3bab-4221-a4bc-c388ce388a9f None admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:14.226734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8a20-3bab-4221-a4bc-c388ce388a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:14.227003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8a20-3bab-4221-a4bc-c388ce388a9f None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/d36276f9c3f840e881d15ece72a94d07/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:14.241017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f8a20-3bab-4221-a4bc-c388ce388a9f None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=d36276f9c3f840e881d15ece72a94d07, role_id=1beb7c9ed4094a7d9a1fc9e83a8c252c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:14.242475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f8a20-3bab-4221-a4bc-c388ce388a9f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:14.312507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 615/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:10:14 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/d36276f9c3f840e881d15ece72a94d07/roles/1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:10:16.214048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e495-27ed-4d30-b6d3-ab9da0756f54 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:16.214616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e495-27ed-4d30-b6d3-ab9da0756f54 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:16.214616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19e495-27ed-4d30-b6d3-ab9da0756f54 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:16.216006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 618/1233] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:16.221517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e71b1-961a-4bf5-aabd-582e2b59dc8a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:16.221979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e71b1-961a-4bf5-aabd-582e2b59dc8a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:16.222082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e71b1-961a-4bf5-aabd-582e2b59dc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:16.241152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f95e71b1-961a-4bf5-aabd-582e2b59dc8a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:16.242330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f95e71b1-961a-4bf5-aabd-582e2b59dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:16.308151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 616/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 10:10:16.579897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e495-27ed-4d30-b6d3-ab9da0756f54 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:16.605557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:16.680517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19e495-27ed-4d30-b6d3-ab9da0756f54 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:16.714593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3686b-9ee0-48b3-8d38-ae8de56cae1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:16.715204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3686b-9ee0-48b3-8d38-ae8de56cae1a None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:16.715481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3686b-9ee0-48b3-8d38-ae8de56cae1a None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:16.715748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3686b-9ee0-48b3-8d38-ae8de56cae1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:16.725990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3686b-9ee0-48b3-8d38-ae8de56cae1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-51a3686b-9ee0-48b3-8d38-ae8de56cae1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:10:16.730750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:16.731898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:16.733243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 619/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 28 10:10:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:16.737974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e71b1-961a-4bf5-aabd-582e2b59dc8a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:16.785093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:16.838780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e71b1-961a-4bf5-aabd-582e2b59dc8a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:16.872092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:16.872725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:16.872998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:16.873266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:16.873923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] RBAC: Adding query filter params (name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:16.874221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:16.875592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:16.884064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 617/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 28 10:10:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:16.889934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3686b-9ee0-48b3-8d38-ae8de56cae1a None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:16.973876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:16.988853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3686b-9ee0-48b3-8d38-ae8de56cae1a None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:17.022058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:17.022668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:17.022942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:17.023210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:17.032917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:17.034585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:17.049106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:17.056636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:17.057786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:17.057786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:17.057786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:17.057786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 620/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:17.058067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:17.157732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34431947-f56c-45fb-83cf-832324490e2b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:17.167121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:17.190712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:17.191309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:17.191586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:17.191930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:17.192601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:17.192900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:17.194258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:17.206146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 618/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:17.212562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:17.309959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804052-58c7-43d7-b1af-8f88d00475f3 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:17.343961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:17.344683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:17.345026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:17.345299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:17.350041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:17.354374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:17.355799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:10:17.366769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:17.367936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:17.369123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 621/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:17.373666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:17.471350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e512f82-f278-4266-9199-67fbfe5c4ad6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:17.504989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:17.505589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:17.505861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:17.506175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:17.506902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:17.507203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:17.508651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:17.526094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 619/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 10:10:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:17.532032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:17.629152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa554e-7572-44a2-a335-396d5a9ee55b None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:17.663475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfff414-d5e9-4a43-bffb-0a8e1f7a0fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:17.664060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfff414-d5e9-4a43-bffb-0a8e1f7a0fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:17.664437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfff414-d5e9-4a43-bffb-0a8e1f7a0fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:17.664714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfff414-d5e9-4a43-bffb-0a8e1f7a0fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:17.726418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:17.732692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfff414-d5e9-4a43-bffb-0a8e1f7a0fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:17.734192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfff414-d5e9-4a43-bffb-0a8e1f7a0fe9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:17.830347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 622/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:10:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:10:17.836393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:17.863098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:17.933069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420a43b-d3f7-45c7-9102-590bd6200a9f None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:17.967567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:17.968193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:17.968499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:17.968802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:17.983186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:17.983186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:17.996039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:17.997185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:17.998280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:17.998280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:17.998280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:17.998280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 620/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:18.002889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfff414-d5e9-4a43-bffb-0a8e1f7a0fe9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:18.094817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:18.100779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfff414-d5e9-4a43-bffb-0a8e1f7a0fe9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:18.134756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:18.135348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:18.135625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:18.135897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:18.136560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:18.136858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:18.138199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:18.149457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 623/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:18.155394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:18.235287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:18.256636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e844e-0ae4-45d3-ab1c-88682c5f2f8b None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:18.290501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:18.291115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:18.291387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:18.291652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:18.298014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:18.299451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:10:18.311186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:18.313978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:18.315111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 621/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:10:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:18.318530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:18.420721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e1e60-cbab-4576-92d4-b93547800e26 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:18.457023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02242bf6-81f5-4031-8dc7-1e970801ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:18.457760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242bf6-81f5-4031-8dc7-1e970801ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:18.458046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242bf6-81f5-4031-8dc7-1e970801ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:18.458320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242bf6-81f5-4031-8dc7-1e970801ddc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:18.459010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02242bf6-81f5-4031-8dc7-1e970801ddc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:18.459316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02242bf6-81f5-4031-8dc7-1e970801ddc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:18.460835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02242bf6-81f5-4031-8dc7-1e970801ddc9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:18.473605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 624/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:18.479846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:18.579436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705184e-c41a-4ab3-ad83-8c67341f69a9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:18.614345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ded74-e34c-4a34-a607-8fdbadeb2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:18.614938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ded74-e34c-4a34-a607-8fdbadeb2523 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:18.615211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ded74-e34c-4a34-a607-8fdbadeb2523 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:18.615479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ded74-e34c-4a34-a607-8fdbadeb2523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:18.616197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ded74-e34c-4a34-a607-8fdbadeb2523 None admin] RBAC: Adding query filter params (role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=d36276f9c3f840e881d15ece72a94d07) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:18.616532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ded74-e34c-4a34-a607-8fdbadeb2523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:18.617948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ded74-e34c-4a34-a607-8fdbadeb2523 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:18.623489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 622/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:10:18 2022] GET /identity/v3/role_assignments?user.id=d36276f9c3f840e881d15ece72a94d07&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=1beb7c9ed4094a7d9a1fc9e83a8c252c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:20.586299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0f8dc-ac51-406e-86af-9ebfbf0dd09e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:20.586850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0f8dc-ac51-406e-86af-9ebfbf0dd09e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:20.586850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0f8dc-ac51-406e-86af-9ebfbf0dd09e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:20.588205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 625/1247] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:20.593796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90740cd-33f5-48f3-a0dd-4a8ed3290330 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:20.594231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90740cd-33f5-48f3-a0dd-4a8ed3290330 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:20.594404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90740cd-33f5-48f3-a0dd-4a8ed3290330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:20.600918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:20.612766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b90740cd-33f5-48f3-a0dd-4a8ed3290330 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:20.613996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b90740cd-33f5-48f3-a0dd-4a8ed3290330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:20.679981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 623/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:10:20.951139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0f8dc-ac51-406e-86af-9ebfbf0dd09e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:20.969663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:21.053157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0f8dc-ac51-406e-86af-9ebfbf0dd09e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:21.086976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff858357-9d70-45af-8297-e6847d4edfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:21.087696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff858357-9d70-45af-8297-e6847d4edfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:21.088094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff858357-9d70-45af-8297-e6847d4edfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:21.088475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff858357-9d70-45af-8297-e6847d4edfe2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:21.099317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff858357-9d70-45af-8297-e6847d4edfe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-ff858357-9d70-45af-8297-e6847d4edfe2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:10:21.104568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:21.105983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:21.107082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 626/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:21.111623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90740cd-33f5-48f3-a0dd-4a8ed3290330 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:21.210628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90740cd-33f5-48f3-a0dd-4a8ed3290330 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:21.238415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:21.243160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:21.243848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:21.244125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:21.244426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:21.245092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:21.245391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:21.246762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:21.255304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 624/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:10:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:10:21.260926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff858357-9d70-45af-8297-e6847d4edfe2 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:21.335445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:21.357029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff858357-9d70-45af-8297-e6847d4edfe2 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:21.390251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:21.390871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:21.391154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:21.391427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:21.402022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:21.403472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:21.418752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:21.419920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:21.420908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:21.420908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:21.420908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:21.420908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 627/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:21.425656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:21.526385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9d31-d61e-48aa-8c78-995a7afc1feb None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:21.561071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:21.561698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:21.561973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:21.562239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:21.562877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:21.563174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:21.564574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:21.576169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 625/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:21.582922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:21.681901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871516b-3d2e-4b5a-a382-298209f09478 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:21.708090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:21.715652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:21.716264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:21.716569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:21.716839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:21.724671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:21.726086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:10:21.736854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:21.738132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:21.739608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 628/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:21.743876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:21.799571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:21.842699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba14e33-0dbe-43f3-bd3b-720d8586060c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:21.876157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:21.876812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:21.877089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:21.877508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:21.878128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:21.878430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:21.879977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:21.896974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 626/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 10:10:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:21.902927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:22.002312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b0655-5c30-42c4-be02-7b0b43dcebed None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:22.037202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac55a59-4c2d-4201-9a46-457aa41caa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:22.037802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac55a59-4c2d-4201-9a46-457aa41caa9f None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:22.038076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac55a59-4c2d-4201-9a46-457aa41caa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:22.038352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac55a59-4c2d-4201-9a46-457aa41caa9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:22.094840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:22.106555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac55a59-4c2d-4201-9a46-457aa41caa9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:22.107987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac55a59-4c2d-4201-9a46-457aa41caa9f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:22.204456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 629/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:10:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 10:10:22.211042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:22.308800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ea0c-ba9b-4e5a-a458-d67096669bfc None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:22.322474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:22.342300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:22.342914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:22.343188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:22.343454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:22.353224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:22.354658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:22.369245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:22.370435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:22.371716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:22.371716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:22.371716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:22.371716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 627/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:22.376064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac55a59-4c2d-4201-9a46-457aa41caa9f None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:22.463138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:22.474903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac55a59-4c2d-4201-9a46-457aa41caa9f None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:22.508773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:22.509457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:22.509735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:22.510007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:22.510654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:22.510954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:22.512476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:22.523780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 630/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:22.529550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:22.629803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2933f-99e3-4ccd-b7cd-acbbcb18b2f6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:22.662886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:22.663502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:22.663778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:22.664064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:22.670661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:22.672360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:10:22.683937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:22.685102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:22.686257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 628/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:10:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:10:22.693884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:22.791350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4d487-bfa0-45b0-a878-2eb20a521c21 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:22.823469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679633c1-e094-4cc1-a742-6ea23a488f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:22.824058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679633c1-e094-4cc1-a742-6ea23a488f95 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:22.824424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679633c1-e094-4cc1-a742-6ea23a488f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:22.824698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679633c1-e094-4cc1-a742-6ea23a488f95 None admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:22.825393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679633c1-e094-4cc1-a742-6ea23a488f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:22.825691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679633c1-e094-4cc1-a742-6ea23a488f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:22.827103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679633c1-e094-4cc1-a742-6ea23a488f95 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:22.841387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 631/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:10:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:22.847572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:22.874657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:22.947666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45d970-dcaf-4505-a8e7-bd9fb3bde021 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:22.980651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329c58-cc91-48f5-b309-4ef335f5aded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:22.981242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329c58-cc91-48f5-b309-4ef335f5aded None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:22.981517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329c58-cc91-48f5-b309-4ef335f5aded None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:22.981782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329c58-cc91-48f5-b309-4ef335f5aded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:22.982497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329c58-cc91-48f5-b309-4ef335f5aded None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=d36276f9c3f840e881d15ece72a94d07) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:22.982799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329c58-cc91-48f5-b309-4ef335f5aded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:22.984236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329c58-cc91-48f5-b309-4ef335f5aded None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:22.990359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 629/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:10:22 2022] GET /identity/v3/role_assignments?user.id=d36276f9c3f840e881d15ece72a94d07&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=fe95a036fa044c4bb408b793fba6436a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:24.867395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ca7a-77ad-4b9d-8078-ed6d916d376f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:24.867928 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ca7a-77ad-4b9d-8078-ed6d916d376f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:24.867928 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29ca7a-77ad-4b9d-8078-ed6d916d376f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:24.869374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 632/1261] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:24.874539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2607f1-663b-442b-8e4f-fb6e5f4dcdec None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:24.874947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2607f1-663b-442b-8e4f-fb6e5f4dcdec None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:24.875089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2607f1-663b-442b-8e4f-fb6e5f4dcdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:24.894331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7b2607f1-663b-442b-8e4f-fb6e5f4dcdec None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:24.895643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7b2607f1-663b-442b-8e4f-fb6e5f4dcdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:24.961951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 630/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:10:25.233371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ca7a-77ad-4b9d-8078-ed6d916d376f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:25.245103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:25.336486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29ca7a-77ad-4b9d-8078-ed6d916d376f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:25.369782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b7669-b8b2-4344-b649-589985414cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:25.370393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b7669-b8b2-4344-b649-589985414cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:25.370670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b7669-b8b2-4344-b649-589985414cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:25.370940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b7669-b8b2-4344-b649-589985414cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:25.381023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b7669-b8b2-4344-b649-589985414cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-3f8b7669-b8b2-4344-b649-589985414cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:10:25.385751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:25.386916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:25.388085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 633/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:25.392788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2607f1-663b-442b-8e4f-fb6e5f4dcdec None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:25.412968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:25.491204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2607f1-663b-442b-8e4f-fb6e5f4dcdec None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:25.523850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:25.524504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:25.524810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:25.525079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:25.525743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:25.526040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:25.527424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:25.536045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 631/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:25.541584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b7669-b8b2-4344-b649-589985414cf5 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:25.608756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:25.641465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b7669-b8b2-4344-b649-589985414cf5 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:25.674198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:25.674810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:25.675089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:25.675359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:25.685462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:25.686890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:25.700927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:25.702079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:25.703180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:25.703180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:25.703180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:25.703180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 634/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:25.708479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:25.790457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:25.808537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5224f6b-4b08-4062-8bd9-58dbc778ce25 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:25.843743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:25.844379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:25.844657 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:25.844941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:25.845575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:25.845872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:25.847338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:25.859028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 632/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:25.864858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:25.962292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f1051-e7f6-47a4-a1c6-ae99b56d5d22 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:25.981563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:25.995698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:25.996313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:25.996610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:25.996878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:26.004052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:26.005900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:10:26.016723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:26.017878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:26.019075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 635/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:10:26.023806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:26.124301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc4bf8-1a87-4db0-9703-1b583cfdca3d None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:26.156948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:26.157610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:26.158144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:26.158413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:26.159132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:26.159473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:26.161685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:26.170581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:26.178387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 633/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 10:10:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:26.184266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:26.283334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269ec17-1a7e-4973-9940-2d006199b1a1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:26.316626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:26.317249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:26.317522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:26.317793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:26.328207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:26.329745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:26.344219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:26.348907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:26.349964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:26.349964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:26.349964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:26.349964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 636/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:26.352064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:26.450936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83395d0e-39bc-4085-9d24-1ff0e5d8d0af None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:26.484410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:26.485023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:26.485307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:26.485582 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:26.486229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:26.486538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:26.487946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:26.499205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 634/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:26.505744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:26.537734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:26.603894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cb272-6b5b-4a30-8d5f-f305b155addb None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:26.636931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:26.637545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:26.637824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:26.638094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:26.645469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:26.647619 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:10:26.659189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:26.660431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:26.661418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 637/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:26.666341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:26.725126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:26.765654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81c9a-1ad7-4b25-8321-7194c6826e5c None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:26.798578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c219e4-6ede-457c-8c68-f84bb04b06c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:26.799176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c219e4-6ede-457c-8c68-f84bb04b06c1 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:26.799450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c219e4-6ede-457c-8c68-f84bb04b06c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:26.799719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c219e4-6ede-457c-8c68-f84bb04b06c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:26.800434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c219e4-6ede-457c-8c68-f84bb04b06c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:26.800737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c219e4-6ede-457c-8c68-f84bb04b06c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:26.803002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c219e4-6ede-457c-8c68-f84bb04b06c1 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:26.814527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 635/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:26.821581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:26.914053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:26.922874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0962c-b514-40ea-8ce2-d2fd3841145c None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:26.956878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b98dbf-6de5-49e4-a50d-d03de076f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:26.957687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b98dbf-6de5-49e4-a50d-d03de076f90f None admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:26.957962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b98dbf-6de5-49e4-a50d-d03de076f90f None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:26.958265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b98dbf-6de5-49e4-a50d-d03de076f90f None admin] PATH_INFO: `/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/d36276f9c3f840e881d15ece72a94d07/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:26.960125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b98dbf-6de5-49e4-a50d-d03de076f90f None admin] RBAC: Authorizing `identity:create_grant(project_id=2c09b15978874aed9b128f6cf9006ae7, user_id=d36276f9c3f840e881d15ece72a94d07, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:26.961572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b98dbf-6de5-49e4-a50d-d03de076f90f None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:27.056520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 638/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 28 10:10:26 2022] PUT /identity/v3/projects/2c09b15978874aed9b128f6cf9006ae7/users/d36276f9c3f840e881d15ece72a94d07/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:10:28.950141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55360f-e281-4cff-8b77-04248f31271f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:28.950711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55360f-e281-4cff-8b77-04248f31271f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:28.950711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55360f-e281-4cff-8b77-04248f31271f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:28.952063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 636/1274] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:28.957364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4278-6281-4fd7-b7c2-51ae0479d6f6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:28.957941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4278-6281-4fd7-b7c2-51ae0479d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:28.957941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4278-6281-4fd7-b7c2-51ae0479d6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:28.976037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-344d4278-6281-4fd7-b7c2-51ae0479d6f6 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:28.977276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-344d4278-6281-4fd7-b7c2-51ae0479d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:29.043711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 639/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:10:29.315987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55360f-e281-4cff-8b77-04248f31271f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:29.415434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55360f-e281-4cff-8b77-04248f31271f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:29.433064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:29.451228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab3f6-257d-4c04-a13a-1767c5a06e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:29.451848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab3f6-257d-4c04-a13a-1767c5a06e63 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:29.452123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab3f6-257d-4c04-a13a-1767c5a06e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:29.452427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab3f6-257d-4c04-a13a-1767c5a06e63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:29.462080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aab3f6-257d-4c04-a13a-1767c5a06e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-87aab3f6-257d-4c04-a13a-1767c5a06e63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 10:10:29.466803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:29.467927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:29.469222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 637/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 28 10:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:29.474622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d4278-6281-4fd7-b7c2-51ae0479d6f6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:29.558453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:29.576209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d4278-6281-4fd7-b7c2-51ae0479d6f6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:29.611291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:29.611895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:29.612178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:29.612492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:29.613226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:29.614060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:29.615508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:29.623430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 640/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 28 10:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:10:29.629327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab3f6-257d-4c04-a13a-1767c5a06e63 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:29.729811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab3f6-257d-4c04-a13a-1767c5a06e63 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:29.763717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:29.764363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:29.764646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:29.764917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:29.775485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:29.777035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:29.791877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:29.792968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:29.793909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:29.793909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:29.793909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:29.793909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 638/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:29.799069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:29.897206 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faad4f-3ba5-4ef6-af86-c0867857f267 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:29.930670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:29.931266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:29.931546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:29.931820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:29.932489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:29.932794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:29.934195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:29.946337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 641/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:29.952091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:29.982975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:30.053674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79cc1f4-12da-4fe4-9fa9-376108336ac6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:30.088941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:30.089451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:30.089985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:30.090439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:30.099804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:30.102779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 10:10:30.116686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:30.117820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 10:10:30.118812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:30.120475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 639/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:30.123996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:30.127988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:30.233599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070417f-251d-47a8-9fab-fc6607b3aac1 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:30.269560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:30.270197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:30.270781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:30.271145 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:30.271818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:30.272125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:30.273750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:30.294363 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 642/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 28 10:10:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:30.301332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:30.397959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:30.407460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9ddae-efc6-4be5-befa-e8885dffa4d6 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:30.442922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d06b8-fb6a-404a-8eea-05309a05a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:30.443541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d06b8-fb6a-404a-8eea-05309a05a75a None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:30.443822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d06b8-fb6a-404a-8eea-05309a05a75a None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:30.444094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d06b8-fb6a-404a-8eea-05309a05a75a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:30.512701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d06b8-fb6a-404a-8eea-05309a05a75a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:30.514170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d06b8-fb6a-404a-8eea-05309a05a75a None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:30.601942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:30.611430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 640/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 28 10:10:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 10:10:30.617500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:30.677752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:30.714414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8d000-fbf2-4028-b912-62f159fb6f54 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:30.748395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:30.749014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:30.749293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:30.749563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:30.759909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:30.761361 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 10:10:30.775760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:30.776924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 10:10:30.777871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 10:10:30.777871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 10:10:30.777871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:30.777871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 643/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:30.782896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d06b8-fb6a-404a-8eea-05309a05a75a None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:30.884164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d06b8-fb6a-404a-8eea-05309a05a75a None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:30.918021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:30.918619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:30.918897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:30.919171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:30.919847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:30.920147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:30.921559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:30.935811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 641/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 28 10:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:30.938208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:31.037907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b39df9-1c4d-4bd8-a5bf-fb1e11ed9ecd None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:31.053304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:31.072389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:31.072999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:31.073274 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:31.073545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:31.079950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:31.081405 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 10:10:31.093036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:31.094108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: ERROR keystone.server.flask.application Aug 28 10:10:31.102319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 644/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 28 10:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:31.102963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:31.150137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:31.197562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c11cb-777c-4343-8796-8b005155dffd None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:31.230078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b7ba5-abe9-4634-812b-8a156c50c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:31.230670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7ba5-abe9-4634-812b-8a156c50c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:31.230964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7ba5-abe9-4634-812b-8a156c50c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:31.231218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b7ba5-abe9-4634-812b-8a156c50c3f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:31.231999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b7ba5-abe9-4634-812b-8a156c50c3f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:31.232321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b7ba5-abe9-4634-812b-8a156c50c3f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:31.233786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b7ba5-abe9-4634-812b-8a156c50c3f4 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:31.245840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 642/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 28 10:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:10:31.251947 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:31.350187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39269a3-11d1-4f2f-9ae1-a026ff16d8d9 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:31.384030 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5da1b-78f5-4290-98aa-d2bdceee9099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:31.384645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5da1b-78f5-4290-98aa-d2bdceee9099 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:31.384927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5da1b-78f5-4290-98aa-d2bdceee9099 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:31.385197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5da1b-78f5-4290-98aa-d2bdceee9099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:31.385940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5da1b-78f5-4290-98aa-d2bdceee9099 None admin] RBAC: Adding query filter params (role.id=fe95a036fa044c4bb408b793fba6436a, scope.project.id=2c09b15978874aed9b128f6cf9006ae7, user.id=d36276f9c3f840e881d15ece72a94d07) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:31.386248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5da1b-78f5-4290-98aa-d2bdceee9099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:31.387667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5da1b-78f5-4290-98aa-d2bdceee9099 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:31.393350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 645/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 28 10:10:31 2022] GET /identity/v3/role_assignments?user.id=d36276f9c3f840e881d15ece72a94d07&scope.project.id=2c09b15978874aed9b128f6cf9006ae7&role.id=fe95a036fa044c4bb408b793fba6436a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:33.303153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f79d6-7454-4ed9-abb6-5b239367cd59 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:33.303686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f79d6-7454-4ed9-abb6-5b239367cd59 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:33.303686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f79d6-7454-4ed9-abb6-5b239367cd59 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:33.305084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 643/1288] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:33.310371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63840d-03c2-4082-b628-6a0352fc1b87 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:33.316006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63840d-03c2-4082-b628-6a0352fc1b87 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:33.316006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63840d-03c2-4082-b628-6a0352fc1b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:33.329200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2e63840d-03c2-4082-b628-6a0352fc1b87 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:33.330370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2e63840d-03c2-4082-b628-6a0352fc1b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:33.360312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:33.397203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 646/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:10:33.666225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f79d6-7454-4ed9-abb6-5b239367cd59 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:33.770183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f79d6-7454-4ed9-abb6-5b239367cd59 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:33.780705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:33.804709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:33.805326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:33.805599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:33.805865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:33.806444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:33.807831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:33.817114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:33.818458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:33.819644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 644/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:10:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 10:10:33.824321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63840d-03c2-4082-b628-6a0352fc1b87 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:33.922011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63840d-03c2-4082-b628-6a0352fc1b87 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:33.956249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c109-e902-4a5a-b6b0-3cb403397504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:33.957019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c109-e902-4a5a-b6b0-3cb403397504 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:33.957339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c109-e902-4a5a-b6b0-3cb403397504 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:33.957577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c109-e902-4a5a-b6b0-3cb403397504 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:33.958220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481c109-e902-4a5a-b6b0-3cb403397504 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:33.958518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481c109-e902-4a5a-b6b0-3cb403397504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:33.959895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481c109-e902-4a5a-b6b0-3cb403397504 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:33.964678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 647/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 28 10:10:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:33.970408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:34.068763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee0676-6fea-490c-bbc0-6dd0bcaac764 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:34.101820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7346f8-b9c0-4889-971a-7baff0628afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:34.102410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7346f8-b9c0-4889-971a-7baff0628afc None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:34.102686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7346f8-b9c0-4889-971a-7baff0628afc None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:34.102953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7346f8-b9c0-4889-971a-7baff0628afc None admin] PATH_INFO: `/v3/services` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:34.103577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7346f8-b9c0-4889-971a-7baff0628afc None admin] RBAC: Adding query filter params (type=placement) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:34.103874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7346f8-b9c0-4889-971a-7baff0628afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:34.105275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7346f8-b9c0-4889-971a-7baff0628afc None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:34.109772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 645/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 28 10:10:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:36.010501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda90df-2caa-41f0-b0a3-e19c26fb075b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:36.011038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda90df-2caa-41f0-b0a3-e19c26fb075b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:36.011038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda90df-2caa-41f0-b0a3-e19c26fb075b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:36.012394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 648/1293] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:36.017534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590f9e5-4b36-495d-bc65-b593d8f82e05 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:36.017960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590f9e5-4b36-495d-bc65-b593d8f82e05 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:36.018080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590f9e5-4b36-495d-bc65-b593d8f82e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:36.037315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2590f9e5-4b36-495d-bc65-b593d8f82e05 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:36.038504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2590f9e5-4b36-495d-bc65-b593d8f82e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:36.067465 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:36.103967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 646/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:10:36.377111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda90df-2caa-41f0-b0a3-e19c26fb075b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:36.409077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:36.476865 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda90df-2caa-41f0-b0a3-e19c26fb075b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:36.510541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808a40a-04fa-4bbf-a5a3-8113d0ddddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:36.511158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808a40a-04fa-4bbf-a5a3-8113d0ddddfc None admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:36.511436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808a40a-04fa-4bbf-a5a3-8113d0ddddfc None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:36.511713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808a40a-04fa-4bbf-a5a3-8113d0ddddfc None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:36.512404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808a40a-04fa-4bbf-a5a3-8113d0ddddfc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:36.513751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808a40a-04fa-4bbf-a5a3-8113d0ddddfc None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:36.604709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 649/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 28 10:10:36 2022] POST /identity/v3/services => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:10:38.519905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57402-6299-4c00-9442-ed0570d4036e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:38.520482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57402-6299-4c00-9442-ed0570d4036e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:38.520578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb57402-6299-4c00-9442-ed0570d4036e None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:38.521874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 647/1296] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:38.527186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c32f3-521e-48fe-8219-1d8d7270c1a4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:38.527590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c32f3-521e-48fe-8219-1d8d7270c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:38.527737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c32f3-521e-48fe-8219-1d8d7270c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:38.546277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-404c32f3-521e-48fe-8219-1d8d7270c1a4 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:38.547453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-404c32f3-521e-48fe-8219-1d8d7270c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:38.621853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 650/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:10:38.893551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57402-6299-4c00-9442-ed0570d4036e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:38.994290 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb57402-6299-4c00-9442-ed0570d4036e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:39.027889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:39.028535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:39.028817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:39.029090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] PATH_INFO: `/v3/services/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:39.029675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:39.031066 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:39.040641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:39.041827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:39.043006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 648/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:10:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:39.047757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c32f3-521e-48fe-8219-1d8d7270c1a4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:39.068180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:39.151022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c32f3-521e-48fe-8219-1d8d7270c1a4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:39.184699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:39.185293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:39.185573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:39.185921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:39.186553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:39.186852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:39.188195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:39.193900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 651/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 28 10:10:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:39.199975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:39.231208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:39.298167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ea9cd-efc9-4ee2-95f2-337002a1edde None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:39.332218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4b9a6-a1c5-44c6-88ee-c60101d9e2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:39.332848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4b9a6-a1c5-44c6-88ee-c60101d9e2fe None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:39.333123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4b9a6-a1c5-44c6-88ee-c60101d9e2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:39.333395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4b9a6-a1c5-44c6-88ee-c60101d9e2fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:39.334099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4b9a6-a1c5-44c6-88ee-c60101d9e2fe None admin] RBAC: Adding query filter params (interface=public, service_id=2e9af23f8ca04900a9f7776accf81379, region_id=RegionOne) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:39.334407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4b9a6-a1c5-44c6-88ee-c60101d9e2fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:39.335779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4b9a6-a1c5-44c6-88ee-c60101d9e2fe None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:39.341005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 649/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 28 10:10:39 2022] GET /identity/v3/endpoints?service_id=2e9af23f8ca04900a9f7776accf81379&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:39.346695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:39.428408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:39.446705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec74f80-7271-48fb-8d64-367dcce26020 None admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:39.480995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ed75d-6234-47c1-8638-dde070f99aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:39.481713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ed75d-6234-47c1-8638-dde070f99aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:39.481993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ed75d-6234-47c1-8638-dde070f99aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:39.482265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ed75d-6234-47c1-8638-dde070f99aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:39.482867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ed75d-6234-47c1-8638-dde070f99aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:39.484221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ed75d-6234-47c1-8638-dde070f99aa3 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:39.491185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 652/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 28 10:10:39 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:10:41.398445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74224-f4c7-43cb-ac1d-3fadac698dc1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:41.399000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74224-f4c7-43cb-ac1d-3fadac698dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:41.399000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74224-f4c7-43cb-ac1d-3fadac698dc1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:41.400567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 650/1302] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:10:41.405648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231fb8a-58a8-411b-9cd2-e3e78c96e1e4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:41.406122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231fb8a-58a8-411b-9cd2-e3e78c96e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:41.406218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231fb8a-58a8-411b-9cd2-e3e78c96e1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:41.424365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8231fb8a-58a8-411b-9cd2-e3e78c96e1e4 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:10:41.426079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8231fb8a-58a8-411b-9cd2-e3e78c96e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:10:41.490955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 653/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:10:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 10:10:41.761766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74224-f4c7-43cb-ac1d-3fadac698dc1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:41.857421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:41.864146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74224-f4c7-43cb-ac1d-3fadac698dc1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:41.897251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:41.897863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:41.898140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:41.898410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:41.898990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:41.900385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 10:10:41.909201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 10:10:41.911133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application with Lock( Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self._enter() Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application return self.creator() Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application created_value = creator( Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: ERROR keystone.server.flask.application Aug 28 10:10:41.912164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 651/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 28 10:10:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 10:10:41.917606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231fb8a-58a8-411b-9cd2-e3e78c96e1e4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:41.993438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:42.015394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231fb8a-58a8-411b-9cd2-e3e78c96e1e4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:42.050580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed2bd5-e047-4c3a-81c2-52d08682cc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:42.051273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2bd5-e047-4c3a-81c2-52d08682cc23 None admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:42.051549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2bd5-e047-4c3a-81c2-52d08682cc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:42.051818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed2bd5-e047-4c3a-81c2-52d08682cc23 None admin] PATH_INFO: `/v3/services` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:42.052472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed2bd5-e047-4c3a-81c2-52d08682cc23 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:10:42.052770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed2bd5-e047-4c3a-81c2-52d08682cc23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:42.054159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed2bd5-e047-4c3a-81c2-52d08682cc23 None admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:42.059181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 654/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 28 10:10:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:10:42.065044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:10:42.164209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4542b-935c-417a-87ff-f82933170ec9 None admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:10:42.196831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2a939-de78-49b4-ac0b-d6ed06d38245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:10:42.197428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2a939-de78-49b4-ac0b-d6ed06d38245 None admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:10:42.197709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2a939-de78-49b4-ac0b-d6ed06d38245 None admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:10:42.197983 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2a939-de78-49b4-ac0b-d6ed06d38245 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:10:42.198649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2a939-de78-49b4-ac0b-d6ed06d38245 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:10:42.200081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2a939-de78-49b4-ac0b-d6ed06d38245 None admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:10:42.290295 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 652/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:10:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:10:52.056195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=30 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:10:52.285728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:45.909826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6abcb-b351-43e0-a9f7-9767bec43639 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:45.910954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6abcb-b351-43e0-a9f7-9767bec43639 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:45.911122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6abcb-b351-43e0-a9f7-9767bec43639 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:45.912440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 655/1307] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:16:45.917995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04aa74-6d64-4c55-9768-2ef640efed03 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:45.918460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04aa74-6d64-4c55-9768-2ef640efed03 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:45.918556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04aa74-6d64-4c55-9768-2ef640efed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:46.029208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2f04aa74-6d64-4c55-9768-2ef640efed03 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:16:46.030420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2f04aa74-6d64-4c55-9768-2ef640efed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:46.249094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 653/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:16:46.557859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a384-377b-4dbb-9c16-ccf9086f3666 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:46.558562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a384-377b-4dbb-9c16-ccf9086f3666 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:46.558562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477a384-377b-4dbb-9c16-ccf9086f3666 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:46.560186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 656/1309] 10.222.0.27 () {54 vars in 965 bytes} [Sun Aug 28 10:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:16:46.567767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824767-dabe-4810-940e-e4b62d46debd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:46.568586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824767-dabe-4810-940e-e4b62d46debd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:46.569258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824767-dabe-4810-940e-e4b62d46debd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:46.664396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-72824767-dabe-4810-940e-e4b62d46debd None None] MFA Rules not processed for user `757ad5baa909451d94dd1eced0407d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:16:46.665863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-72824767-dabe-4810-940e-e4b62d46debd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:46.688962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:46.764228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477a384-377b-4dbb-9c16-ccf9086f3666 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:16:46.766464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5477a384-377b-4dbb-9c16-ccf9086f3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:46.771447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 654/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 28 10:16:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:16:46.912742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477a384-377b-4dbb-9c16-ccf9086f3666 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:16:47.006397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a512b-3d4d-4a8d-90c1-412a5ab70b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:16:47.006971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a512b-3d4d-4a8d-90c1-412a5ab70b2a service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:47.007248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a512b-3d4d-4a8d-90c1-412a5ab70b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:47.007520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a512b-3d4d-4a8d-90c1-412a5ab70b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:47.009209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4c8a512b-3d4d-4a8d-90c1-412a5ab70b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:47.075597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:47.139513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a512b-3d4d-4a8d-90c1-412a5ab70b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:16:47.141097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a512b-3d4d-4a8d-90c1-412a5ab70b2a service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:16:47.162256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 657/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:16:49.385545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8ee4-6f8f-4511-8210-501fe6152cf9 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:49.386081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8ee4-6f8f-4511-8210-501fe6152cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:49.386081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8ee4-6f8f-4511-8210-501fe6152cf9 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:49.387437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 655/1312] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:16:49.392832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123abfe-ba52-4b4f-a120-0b5b5062ee05 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:49.393241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123abfe-ba52-4b4f-a120-0b5b5062ee05 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:49.393525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123abfe-ba52-4b4f-a120-0b5b5062ee05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:49.478302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f123abfe-ba52-4b4f-a120-0b5b5062ee05 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:16:49.479547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f123abfe-ba52-4b4f-a120-0b5b5062ee05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:49.586940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 658/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:16:49.872789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8ee4-6f8f-4511-8210-501fe6152cf9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:16:49.874567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-962f8ee4-6f8f-4511-8210-501fe6152cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:49.977640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8ee4-6f8f-4511-8210-501fe6152cf9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:16:50.047425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:50.049865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465f1e1-e6f7-4a0f-937a-9d77dcf57849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:16:50.050513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465f1e1-e6f7-4a0f-937a-9d77dcf57849 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:50.050790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465f1e1-e6f7-4a0f-937a-9d77dcf57849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:50.051062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465f1e1-e6f7-4a0f-937a-9d77dcf57849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:50.052692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0465f1e1-e6f7-4a0f-937a-9d77dcf57849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:50.157882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465f1e1-e6f7-4a0f-937a-9d77dcf57849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:16:50.159258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465f1e1-e6f7-4a0f-937a-9d77dcf57849 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:16:50.177211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 656/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:16:52.586723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac81b-8b3b-407d-ad8c-078f8436f756 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:52.587265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac81b-8b3b-407d-ad8c-078f8436f756 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:52.587265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac81b-8b3b-407d-ad8c-078f8436f756 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:52.588674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 659/1315] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:16:52.593888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0120-2c4f-42ab-bc40-cbb50eb9c806 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:52.594296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0120-2c4f-42ab-bc40-cbb50eb9c806 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:52.594444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0120-2c4f-42ab-bc40-cbb50eb9c806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:52.658747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-556c0120-2c4f-42ab-bc40-cbb50eb9c806 None None] MFA Rules not processed for user `fd0e69577dc04c68968f75a91a2c3aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:16:52.660516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-556c0120-2c4f-42ab-bc40-cbb50eb9c806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:52.711130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:52.755215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 657/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:16:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:16:53.038994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ac81b-8b3b-407d-ad8c-078f8436f756 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:16:53.040538 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fe3ac81b-8b3b-407d-ad8c-078f8436f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:53.050373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:53.145005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ac81b-8b3b-407d-ad8c-078f8436f756 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:16:53.217790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167b234-b42d-4d03-b767-c6d3924ffd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:16:53.218392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b234-b42d-4d03-b767-c6d3924ffd98 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:53.218671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b234-b42d-4d03-b767-c6d3924ffd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:53.218941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167b234-b42d-4d03-b767-c6d3924ffd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:53.220568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6167b234-b42d-4d03-b767-c6d3924ffd98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:53.281481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:53.326822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167b234-b42d-4d03-b767-c6d3924ffd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:16:53.328185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167b234-b42d-4d03-b767-c6d3924ffd98 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:16:53.346540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 660/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:16:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:16:56.111711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707463c9-85bf-4008-8b1e-72c3a58c15b3 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:56.112228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707463c9-85bf-4008-8b1e-72c3a58c15b3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:56.112356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707463c9-85bf-4008-8b1e-72c3a58c15b3 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:56.113798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 658/1318] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:16:56.118971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080b16d-1680-4fd3-b31c-c23fdf484496 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:56.119367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080b16d-1680-4fd3-b31c-c23fdf484496 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:56.119524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080b16d-1680-4fd3-b31c-c23fdf484496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:56.183795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b080b16d-1680-4fd3-b31c-c23fdf484496 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:16:56.185034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b080b16d-1680-4fd3-b31c-c23fdf484496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:56.279541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 661/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:16:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:16:56.570518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707463c9-85bf-4008-8b1e-72c3a58c15b3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:16:56.572104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-707463c9-85bf-4008-8b1e-72c3a58c15b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:56.673501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707463c9-85bf-4008-8b1e-72c3a58c15b3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:16:56.744870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b42a16-0672-4477-960b-04f21fb1de77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:16:56.745469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42a16-0672-4477-960b-04f21fb1de77 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:56.745746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42a16-0672-4477-960b-04f21fb1de77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:56.746014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b42a16-0672-4477-960b-04f21fb1de77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:56.747603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-63b42a16-0672-4477-960b-04f21fb1de77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:56.755430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:16:56.854728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b42a16-0672-4477-960b-04f21fb1de77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:16:56.856173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b42a16-0672-4477-960b-04f21fb1de77 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:16:56.874901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 659/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:16:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:16:59.843715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6acaf2-61c9-4ebb-ba3c-a635b81c3c47 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:59.844180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6acaf2-61c9-4ebb-ba3c-a635b81c3c47 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:59.844382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6acaf2-61c9-4ebb-ba3c-a635b81c3c47 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:59.845685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 662/1321] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:16:59.851382 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c1ea-f5c8-4616-8e2c-52e584c04183 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:16:59.851804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c1ea-f5c8-4616-8e2c-52e584c04183 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:16:59.851942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c1ea-f5c8-4616-8e2c-52e584c04183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:16:59.918446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2f38c1ea-f5c8-4616-8e2c-52e584c04183 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:16:59.919643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2f38c1ea-f5c8-4616-8e2c-52e584c04183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:16:59.977483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:00.016917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 660/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:00.305542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6acaf2-61c9-4ebb-ba3c-a635b81c3c47 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:00.307070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b6acaf2-61c9-4ebb-ba3c-a635b81c3c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:00.326496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:00.413713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6acaf2-61c9-4ebb-ba3c-a635b81c3c47 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:00.487965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29343391-481f-48a0-9107-5094660a4d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:00.488714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343391-481f-48a0-9107-5094660a4d26 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:00.489009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343391-481f-48a0-9107-5094660a4d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:00.489327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343391-481f-48a0-9107-5094660a4d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:00.490858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-29343391-481f-48a0-9107-5094660a4d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:00.562126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:00.599590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29343391-481f-48a0-9107-5094660a4d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:00.601078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29343391-481f-48a0-9107-5094660a4d26 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:00.619711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 663/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:02.621197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af854af-f6c7-40ed-a26f-04b59ef9d68b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:02.621786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af854af-f6c7-40ed-a26f-04b59ef9d68b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:02.621786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af854af-f6c7-40ed-a26f-04b59ef9d68b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:02.623103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 661/1324] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:02.628931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898479d-74d8-48c6-9c50-146f8b139741 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:02.629578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898479d-74d8-48c6-9c50-146f8b139741 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:02.629578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898479d-74d8-48c6-9c50-146f8b139741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:02.694681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0898479d-74d8-48c6-9c50-146f8b139741 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:02.695905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0898479d-74d8-48c6-9c50-146f8b139741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:02.792362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 664/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:03.083832 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af854af-f6c7-40ed-a26f-04b59ef9d68b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:03.085470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1af854af-f6c7-40ed-a26f-04b59ef9d68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:03.205442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af854af-f6c7-40ed-a26f-04b59ef9d68b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:03.281875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f10d-5918-4c2c-a1b5-ea0ea758bd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:03.282503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f10d-5918-4c2c-a1b5-ea0ea758bd7f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:03.282786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f10d-5918-4c2c-a1b5-ea0ea758bd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:03.283060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f10d-5918-4c2c-a1b5-ea0ea758bd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:03.284845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d4b0f10d-5918-4c2c-a1b5-ea0ea758bd7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:03.302341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:03.403869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f10d-5918-4c2c-a1b5-ea0ea758bd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:03.405277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f10d-5918-4c2c-a1b5-ea0ea758bd7f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:03.423870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 662/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:17:05.433803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0125-0e0d-44d4-9377-0ce564ac25ef None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:05.434377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0125-0e0d-44d4-9377-0ce564ac25ef None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:05.434377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d0125-0e0d-44d4-9377-0ce564ac25ef None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:05.435733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 665/1327] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:05.441811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4bb1-cc46-45af-b813-10966dd1e092 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:05.442364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4bb1-cc46-45af-b813-10966dd1e092 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:05.442364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4bb1-cc46-45af-b813-10966dd1e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:05.507612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2d2f4bb1-cc46-45af-b813-10966dd1e092 None None] MFA Rules not processed for user `fd0e69577dc04c68968f75a91a2c3aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:05.508841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2d2f4bb1-cc46-45af-b813-10966dd1e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:05.574025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:05.606010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 663/1328] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:05.913547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727a55-9081-4934-8ad6-31e57db2dc85 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:05.913766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727a55-9081-4934-8ad6-31e57db2dc85 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:05.914039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727a55-9081-4934-8ad6-31e57db2dc85 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:05.915484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 666/1329] 10.222.0.27 () {54 vars in 965 bytes} [Sun Aug 28 10:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:05.923618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74655c-47f8-457b-84df-15323f3c6b23 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:05.923618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74655c-47f8-457b-84df-15323f3c6b23 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:05.923618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74655c-47f8-457b-84df-15323f3c6b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:06.003696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1d74655c-47f8-457b-84df-15323f3c6b23 None None] MFA Rules not processed for user `757ad5baa909451d94dd1eced0407d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:06.004961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1d74655c-47f8-457b-84df-15323f3c6b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:06.085555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 664/1330] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 28 10:17:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:06.094479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8727a55-9081-4934-8ad6-31e57db2dc85 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:06.096015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a8727a55-9081-4934-8ad6-31e57db2dc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:06.130535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:06.203465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8727a55-9081-4934-8ad6-31e57db2dc85 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:06.281156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e71c1c-639a-486f-8b23-13c17bed72d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:06.281784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71c1c-639a-486f-8b23-13c17bed72d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:06.282068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71c1c-639a-486f-8b23-13c17bed72d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:06.282345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71c1c-639a-486f-8b23-13c17bed72d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:06.283994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-42e71c1c-639a-486f-8b23-13c17bed72d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:06.368239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:06.400148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e71c1c-639a-486f-8b23-13c17bed72d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:06.401598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e71c1c-639a-486f-8b23-13c17bed72d5 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:06.422340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 667/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:09.176321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c018db-4bd1-47ef-882e-0dc7b2092502 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:09.176859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c018db-4bd1-47ef-882e-0dc7b2092502 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:09.176990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c018db-4bd1-47ef-882e-0dc7b2092502 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:09.178319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 665/1332] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:09.183450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60669f-87dc-40f3-a768-3a8b0bd13eee None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:09.183841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60669f-87dc-40f3-a768-3a8b0bd13eee None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:09.184003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60669f-87dc-40f3-a768-3a8b0bd13eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:09.249017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5a60669f-87dc-40f3-a768-3a8b0bd13eee None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:09.250214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5a60669f-87dc-40f3-a768-3a8b0bd13eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:09.346446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 668/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:09.625297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c018db-4bd1-47ef-882e-0dc7b2092502 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:09.626855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a1c018db-4bd1-47ef-882e-0dc7b2092502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:09.695918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:09.729025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c018db-4bd1-47ef-882e-0dc7b2092502 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:09.803185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0a492-22a1-4806-a1d4-456307d5b75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:09.803806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a492-22a1-4806-a1d4-456307d5b75f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:09.804085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a492-22a1-4806-a1d4-456307d5b75f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:09.804385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0a492-22a1-4806-a1d4-456307d5b75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:09.806049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b0c0a492-22a1-4806-a1d4-456307d5b75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:09.926888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0a492-22a1-4806-a1d4-456307d5b75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:09.928362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0a492-22a1-4806-a1d4-456307d5b75f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:09.938225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:09.946943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 666/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:12.049171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6e39-726a-49ea-924b-9d188927aa00 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:12.049728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6e39-726a-49ea-924b-9d188927aa00 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:12.049728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6e39-726a-49ea-924b-9d188927aa00 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:12.051111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 669/1335] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:12.056450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc2fb-4f8c-4417-9025-e236f9bb5672 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:12.056843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc2fb-4f8c-4417-9025-e236f9bb5672 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:12.057003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fc2fb-4f8c-4417-9025-e236f9bb5672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:12.121340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d14fc2fb-4f8c-4417-9025-e236f9bb5672 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:12.122544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d14fc2fb-4f8c-4417-9025-e236f9bb5672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:12.218128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 667/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:12.507175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6e39-726a-49ea-924b-9d188927aa00 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:12.508780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-25cf6e39-726a-49ea-924b-9d188927aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:12.549358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:12.611888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6e39-726a-49ea-924b-9d188927aa00 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:12.684865 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e47df2-33be-4618-8f86-e70092d1786b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:12.685460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e47df2-33be-4618-8f86-e70092d1786b service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:12.685738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e47df2-33be-4618-8f86-e70092d1786b service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:12.686009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e47df2-33be-4618-8f86-e70092d1786b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:12.687583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-76e47df2-33be-4618-8f86-e70092d1786b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:12.770754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:12.798266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e47df2-33be-4618-8f86-e70092d1786b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:12.799936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e47df2-33be-4618-8f86-e70092d1786b service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:12.819099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 670/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:15.406389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5cb0-53d5-483f-8e02-afa4e398526f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:15.406932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5cb0-53d5-483f-8e02-afa4e398526f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:15.406932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af5cb0-53d5-483f-8e02-afa4e398526f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:15.408280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 668/1338] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:15.413569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c43d95-5848-4856-8851-3ef293e5b64d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:15.414029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c43d95-5848-4856-8851-3ef293e5b64d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:15.414155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c43d95-5848-4856-8851-3ef293e5b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:15.478453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-43c43d95-5848-4856-8851-3ef293e5b64d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:15.479644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-43c43d95-5848-4856-8851-3ef293e5b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:15.573876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 671/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:15.865349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af5cb0-53d5-483f-8e02-afa4e398526f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:15.866906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-40af5cb0-53d5-483f-8e02-afa4e398526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:15.943692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:15.972107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af5cb0-53d5-483f-8e02-afa4e398526f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:16.045589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8107c-b0ce-4f53-a5e5-d89a1dd22b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:16.046215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8107c-b0ce-4f53-a5e5-d89a1dd22b07 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:16.046494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8107c-b0ce-4f53-a5e5-d89a1dd22b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:16.046797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8107c-b0ce-4f53-a5e5-d89a1dd22b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:16.048504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cfd8107c-b0ce-4f53-a5e5-d89a1dd22b07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:16.155156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8107c-b0ce-4f53-a5e5-d89a1dd22b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:16.156629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8107c-b0ce-4f53-a5e5-d89a1dd22b07 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:16.174593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 669/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:20.278673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc746bd-c599-430f-8b1b-e2185817961d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:20.279209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc746bd-c599-430f-8b1b-e2185817961d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:20.279209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc746bd-c599-430f-8b1b-e2185817961d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:20.280627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 672/1341] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:20.286497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0948d7-ece7-4d12-86d6-afb402275539 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:20.286937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0948d7-ece7-4d12-86d6-afb402275539 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:20.287048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0948d7-ece7-4d12-86d6-afb402275539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:20.292513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:20.354544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4e0948d7-ece7-4d12-86d6-afb402275539 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:20.355761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4e0948d7-ece7-4d12-86d6-afb402275539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:20.453758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 670/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:20.743783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc746bd-c599-430f-8b1b-e2185817961d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:20.745448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cdc746bd-c599-430f-8b1b-e2185817961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:20.793108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:20.850510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc746bd-c599-430f-8b1b-e2185817961d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:20.923402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516c42d-a973-4092-9558-f852416e3298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:20.924004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516c42d-a973-4092-9558-f852416e3298 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:20.924827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516c42d-a973-4092-9558-f852416e3298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:20.925108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516c42d-a973-4092-9558-f852416e3298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:20.927307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7516c42d-a973-4092-9558-f852416e3298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:21.021722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:21.038105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516c42d-a973-4092-9558-f852416e3298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:21.039717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516c42d-a973-4092-9558-f852416e3298 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:21.059303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 673/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:17:23.982466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50d45-2028-4dd0-aa26-db57cfdff73b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:23.982974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50d45-2028-4dd0-aa26-db57cfdff73b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:23.982974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50d45-2028-4dd0-aa26-db57cfdff73b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:23.984337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 671/1344] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:23.990084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70045-fe26-492b-8741-859dd0f36f12 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:23.990515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70045-fe26-492b-8741-859dd0f36f12 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:23.990765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70045-fe26-492b-8741-859dd0f36f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:24.056606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f0c70045-fe26-492b-8741-859dd0f36f12 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:24.057811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f0c70045-fe26-492b-8741-859dd0f36f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:24.164463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 674/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:24.445494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50d45-2028-4dd0-aa26-db57cfdff73b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:24.447089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6fb50d45-2028-4dd0-aa26-db57cfdff73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:24.538723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:24.555847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50d45-2028-4dd0-aa26-db57cfdff73b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:24.631219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa9ddd-3924-45f0-8247-575cab937b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:24.631840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9ddd-3924-45f0-8247-575cab937b8a service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:24.632116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9ddd-3924-45f0-8247-575cab937b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:24.632421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9ddd-3924-45f0-8247-575cab937b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:24.634068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fdaa9ddd-3924-45f0-8247-575cab937b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:24.747383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa9ddd-3924-45f0-8247-575cab937b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:24.748890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa9ddd-3924-45f0-8247-575cab937b8a service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:24.767755 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 672/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:28.860868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80db18-6912-4b05-89a7-9d59797009cb None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:28.861514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80db18-6912-4b05-89a7-9d59797009cb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:28.861514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80db18-6912-4b05-89a7-9d59797009cb None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:28.862829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 675/1347] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:28.868232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d85e-b3ab-4f9e-a5f7-01eda9c19c51 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:28.868720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d85e-b3ab-4f9e-a5f7-01eda9c19c51 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:28.868821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d85e-b3ab-4f9e-a5f7-01eda9c19c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:28.884927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:28.939118 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6aa7d85e-b3ab-4f9e-a5f7-01eda9c19c51 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:28.941255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6aa7d85e-b3ab-4f9e-a5f7-01eda9c19c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:29.044046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 673/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:17:29.331054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80db18-6912-4b05-89a7-9d59797009cb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:29.332590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dc80db18-6912-4b05-89a7-9d59797009cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:29.389702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:29.433657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80db18-6912-4b05-89a7-9d59797009cb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:29.507248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abb231-b1dd-4006-97f6-5ae0c13c5e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:29.507844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb231-b1dd-4006-97f6-5ae0c13c5e61 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:29.508120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb231-b1dd-4006-97f6-5ae0c13c5e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:29.508419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abb231-b1dd-4006-97f6-5ae0c13c5e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:29.509999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b0abb231-b1dd-4006-97f6-5ae0c13c5e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:29.612244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:29.615683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb231-b1dd-4006-97f6-5ae0c13c5e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:29.617148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abb231-b1dd-4006-97f6-5ae0c13c5e61 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:29.635146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 676/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:34.576701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f91af-190e-49aa-a058-1025d288f7b1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:34.577166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f91af-190e-49aa-a058-1025d288f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:34.577639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f91af-190e-49aa-a058-1025d288f7b1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:34.578661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 674/1350] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:34.584927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c489e-a8fb-4a7b-8912-2d33f8eb08ed None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:34.585335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c489e-a8fb-4a7b-8912-2d33f8eb08ed None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:34.585480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c489e-a8fb-4a7b-8912-2d33f8eb08ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:34.736336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-342c489e-a8fb-4a7b-8912-2d33f8eb08ed None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:34.737841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-342c489e-a8fb-4a7b-8912-2d33f8eb08ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:34.881950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 677/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:17:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:38.938553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5686-33b6-4e45-8276-2b0bba775fda None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:38.939092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5686-33b6-4e45-8276-2b0bba775fda None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:38.939092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b5686-33b6-4e45-8276-2b0bba775fda None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:38.941288 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 675/1352] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:38.946704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311f291-c7d2-435a-971a-c213c08ce5b8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:38.947176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311f291-c7d2-435a-971a-c213c08ce5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:38.947268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311f291-c7d2-435a-971a-c213c08ce5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:39.002527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:39.026445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d311f291-c7d2-435a-971a-c213c08ce5b8 None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:39.028001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d311f291-c7d2-435a-971a-c213c08ce5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:39.042197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=59 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:39.262353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 678/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:17:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:40.515761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ebe9-8105-4798-9e4f-97acbd40f0b5 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:40.516345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ebe9-8105-4798-9e4f-97acbd40f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:40.516446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ebe9-8105-4798-9e4f-97acbd40f0b5 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:40.517842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 676/1354] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:40.523210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d080d-4899-417d-a0e8-49f2e944c74e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:40.527185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d080d-4899-417d-a0e8-49f2e944c74e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:40.527185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d080d-4899-417d-a0e8-49f2e944c74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:40.604861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-477d080d-4899-417d-a0e8-49f2e944c74e None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:40.606059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-477d080d-4899-417d-a0e8-49f2e944c74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:40.648432 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:40.714572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 679/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:17:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:17:44.213758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98dcf-d428-4f4d-bd3a-cd1a6414a019 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:44.214315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98dcf-d428-4f4d-bd3a-cd1a6414a019 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:44.214315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98dcf-d428-4f4d-bd3a-cd1a6414a019 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:44.215818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 677/1356] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:44.221107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435f9e-6350-4ad5-83bb-91fdc5c59982 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:44.221669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435f9e-6350-4ad5-83bb-91fdc5c59982 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:44.227700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10435f9e-6350-4ad5-83bb-91fdc5c59982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:44.300675 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-10435f9e-6350-4ad5-83bb-91fdc5c59982 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:44.301864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-10435f9e-6350-4ad5-83bb-91fdc5c59982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:44.429045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 680/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:17:44.735214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0737-05f2-40ff-a3fe-27f5d62da6d3 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:44.735490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0737-05f2-40ff-a3fe-27f5d62da6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:44.736476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f0737-05f2-40ff-a3fe-27f5d62da6d3 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:44.737803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 678/1358] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 28 10:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:44.749785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb2db-46c4-4fb3-8779-f5fec81990cb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:44.750292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb2db-46c4-4fb3-8779-f5fec81990cb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:44.750701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb2db-46c4-4fb3-8779-f5fec81990cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:44.768376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:44.844466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e32bb2db-46c4-4fb3-8779-f5fec81990cb None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:44.845962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e32bb2db-46c4-4fb3-8779-f5fec81990cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:44.983871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 681/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 10:17:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:44.985484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0737-05f2-40ff-a3fe-27f5d62da6d3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:44.987771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-558f0737-05f2-40ff-a3fe-27f5d62da6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:45.154608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f0737-05f2-40ff-a3fe-27f5d62da6d3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:45.350268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:45.390429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d8748-283e-4f0a-a7ce-c90281488bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:45.391138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8748-283e-4f0a-a7ce-c90281488bc6 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:45.391418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8748-283e-4f0a-a7ce-c90281488bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:45.391691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8748-283e-4f0a-a7ce-c90281488bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:45.393969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ab1d8748-283e-4f0a-a7ce-c90281488bc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:45.490347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d8748-283e-4f0a-a7ce-c90281488bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:45.492334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d8748-283e-4f0a-a7ce-c90281488bc6 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:45.515536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 679/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:47.671728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eef93-cb37-4ed8-93f1-1d385f72a3a0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:47.672288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eef93-cb37-4ed8-93f1-1d385f72a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:47.672288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eef93-cb37-4ed8-93f1-1d385f72a3a0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:47.676335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 682/1361] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:47.679401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dffa19-bef1-4933-ad3c-3dcae6ee076c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:47.679846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dffa19-bef1-4933-ad3c-3dcae6ee076c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:47.680211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dffa19-bef1-4933-ad3c-3dcae6ee076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:47.760499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-08dffa19-bef1-4933-ad3c-3dcae6ee076c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:47.761712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-08dffa19-bef1-4933-ad3c-3dcae6ee076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:47.809705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:47.875342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 680/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:48.177616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eef93-cb37-4ed8-93f1-1d385f72a3a0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:48.179817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-589eef93-cb37-4ed8-93f1-1d385f72a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:48.259995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:48.359924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eef93-cb37-4ed8-93f1-1d385f72a3a0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:48.490010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aef48-6d2a-4e6b-b417-0e70e10f1c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:48.490625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aef48-6d2a-4e6b-b417-0e70e10f1c1d service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:48.490904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aef48-6d2a-4e6b-b417-0e70e10f1c1d service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:48.491175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aef48-6d2a-4e6b-b417-0e70e10f1c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:48.492796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-137aef48-6d2a-4e6b-b417-0e70e10f1c1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:48.515652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:48.587402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aef48-6d2a-4e6b-b417-0e70e10f1c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:48.589048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137aef48-6d2a-4e6b-b417-0e70e10f1c1d service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:48.607542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 683/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:50.999640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dde90-f6c6-43d1-ba86-ff2c7a795e63 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:51.000169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dde90-f6c6-43d1-ba86-ff2c7a795e63 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:51.000169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dde90-f6c6-43d1-ba86-ff2c7a795e63 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:51.002330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 681/1364] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:51.007867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff1ab-34b5-47c2-ba64-387d431a6611 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:51.008401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff1ab-34b5-47c2-ba64-387d431a6611 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:51.008506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff1ab-34b5-47c2-ba64-387d431a6611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:51.081088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-120ff1ab-34b5-47c2-ba64-387d431a6611 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:51.082446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-120ff1ab-34b5-47c2-ba64-387d431a6611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:51.188162 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:51.196346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 684/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:51.488361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621658c-e974-4e56-acaa-693f164c865d None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:51.488944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621658c-e974-4e56-acaa-693f164c865d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:51.489225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621658c-e974-4e56-acaa-693f164c865d None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:51.490567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 682/1366] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 28 10:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:51.496280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92613f-29be-489a-8970-27974384daf9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:51.500153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92613f-29be-489a-8970-27974384daf9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:51.500153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92613f-29be-489a-8970-27974384daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:51.578785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5d92613f-29be-489a-8970-27974384daf9 None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:51.580185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5d92613f-29be-489a-8970-27974384daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:51.711493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 685/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:51.719843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621658c-e974-4e56-acaa-693f164c865d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:51.722260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d621658c-e974-4e56-acaa-693f164c865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:51.894098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621658c-e974-4e56-acaa-693f164c865d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:51.917771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:52.016071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac1f01-d6c6-4e76-aa08-e12e582f56bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:52.017233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac1f01-d6c6-4e76-aa08-e12e582f56bc service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:52.017613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac1f01-d6c6-4e76-aa08-e12e582f56bc service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:52.017984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac1f01-d6c6-4e76-aa08-e12e582f56bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:52.019690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2cac1f01-d6c6-4e76-aa08-e12e582f56bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:52.119263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac1f01-d6c6-4e76-aa08-e12e582f56bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:52.121204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac1f01-d6c6-4e76-aa08-e12e582f56bc service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:52.142529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 683/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:52.437512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e46e-c8a0-435c-aefe-74136b8a43f3 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:52.438045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e46e-c8a0-435c-aefe-74136b8a43f3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:52.438161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e46e-c8a0-435c-aefe-74136b8a43f3 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:52.440231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 686/1369] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:52.445945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f5a2-f640-451f-b53c-d3974e968ecf None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:52.446243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f5a2-f640-451f-b53c-d3974e968ecf None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:52.446504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93f5a2-f640-451f-b53c-d3974e968ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:52.482974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:52.523117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2d93f5a2-f640-451f-b53c-d3974e968ecf None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:52.524245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2d93f5a2-f640-451f-b53c-d3974e968ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:52.625831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 684/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:53.208266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755018d-4b68-487e-830c-13cec2e3ced6 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:53.208266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755018d-4b68-487e-830c-13cec2e3ced6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:53.208266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755018d-4b68-487e-830c-13cec2e3ced6 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:53.210436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 687/1371] 10.222.0.27 () {54 vars in 964 bytes} [Sun Aug 28 10:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:53.214095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280b61-8dff-46ce-ac30-303fa0379cb8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:53.214616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280b61-8dff-46ce-ac30-303fa0379cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:53.214616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280b61-8dff-46ce-ac30-303fa0379cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:53.292699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-99280b61-8dff-46ce-ac30-303fa0379cb8 None None] MFA Rules not processed for user `4b03cdf17a244cf094a7ce93775da22c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:53.293934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-99280b61-8dff-46ce-ac30-303fa0379cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:53.344113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:53.376447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 685/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Aug 28 10:17:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:53.382131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755018d-4b68-487e-830c-13cec2e3ced6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:53.383959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d755018d-4b68-487e-830c-13cec2e3ced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:53.442931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:53.498444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755018d-4b68-487e-830c-13cec2e3ced6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:53.576962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a5d55-146e-48e2-a4ba-8a8b21596530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:53.577643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a5d55-146e-48e2-a4ba-8a8b21596530 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:53.577991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a5d55-146e-48e2-a4ba-8a8b21596530 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:53.578338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a5d55-146e-48e2-a4ba-8a8b21596530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:53.580142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-180a5d55-146e-48e2-a4ba-8a8b21596530 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:53.697198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:53.713969 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a5d55-146e-48e2-a4ba-8a8b21596530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:53.715942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a5d55-146e-48e2-a4ba-8a8b21596530 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:53.740717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 688/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:17:54.261368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb4bd-3e09-49c3-bce4-6de15e1facd8 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:54.261883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb4bd-3e09-49c3-bce4-6de15e1facd8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:54.261883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb4bd-3e09-49c3-bce4-6de15e1facd8 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:54.263484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 686/1374] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:54.269331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0678b6-a4fa-4af6-882d-96a9e4c1c08a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:54.269622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0678b6-a4fa-4af6-882d-96a9e4c1c08a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:54.269900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0678b6-a4fa-4af6-882d-96a9e4c1c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:54.337514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8b0678b6-a4fa-4af6-882d-96a9e4c1c08a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:54.338737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b0678b6-a4fa-4af6-882d-96a9e4c1c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:54.439479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 689/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:54.729586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb4bd-3e09-49c3-bce4-6de15e1facd8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:54.731161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dddeb4bd-3e09-49c3-bce4-6de15e1facd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:54.885846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb4bd-3e09-49c3-bce4-6de15e1facd8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:54.938347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:55.000945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd5e72-b6e2-4881-b94d-34b1e2830846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:55.002476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd5e72-b6e2-4881-b94d-34b1e2830846 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:55.002756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd5e72-b6e2-4881-b94d-34b1e2830846 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:55.003025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd5e72-b6e2-4881-b94d-34b1e2830846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:55.004682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-11fd5e72-b6e2-4881-b94d-34b1e2830846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:55.096820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd5e72-b6e2-4881-b94d-34b1e2830846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:55.098350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd5e72-b6e2-4881-b94d-34b1e2830846 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:55.116556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 687/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:17:57.201481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea69c-828d-4da0-b50c-2bd9916cff14 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:57.202043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea69c-828d-4da0-b50c-2bd9916cff14 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:57.202043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ea69c-828d-4da0-b50c-2bd9916cff14 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:57.203382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 690/1377] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:17:57.209462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d25c-5d72-48a6-8482-d7ea6d995391 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:57.209874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d25c-5d72-48a6-8482-d7ea6d995391 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:57.210006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760d25c-5d72-48a6-8482-d7ea6d995391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:57.290094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d760d25c-5d72-48a6-8482-d7ea6d995391 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:17:57.291328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d760d25c-5d72-48a6-8482-d7ea6d995391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:57.299401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:57.428768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 688/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:17:57.724387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea69c-828d-4da0-b50c-2bd9916cff14 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:17:57.725933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-761ea69c-828d-4da0-b50c-2bd9916cff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:57.790567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:57.887496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ea69c-828d-4da0-b50c-2bd9916cff14 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:17:58.012587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30671e3-cb7b-47b6-b4a1-ae81e7bee6ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:17:58.013190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30671e3-cb7b-47b6-b4a1-ae81e7bee6ba service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:17:58.013540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30671e3-cb7b-47b6-b4a1-ae81e7bee6ba service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:17:58.013880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30671e3-cb7b-47b6-b4a1-ae81e7bee6ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:17:58.015523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c30671e3-cb7b-47b6-b4a1-ae81e7bee6ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:17:58.036506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:17:58.112054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30671e3-cb7b-47b6-b4a1-ae81e7bee6ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:17:58.113783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30671e3-cb7b-47b6-b4a1-ae81e7bee6ba service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:17:58.133548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 691/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:00.231398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2e254-3751-4505-a746-6133cdb64ece None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:00.232003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2e254-3751-4505-a746-6133cdb64ece None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:00.232003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2e254-3751-4505-a746-6133cdb64ece None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:00.236802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 689/1380] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:18:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:00.239551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35e85-57eb-4d30-9643-3111de0052a7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:00.240114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35e85-57eb-4d30-9643-3111de0052a7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:00.240114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35e85-57eb-4d30-9643-3111de0052a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:00.312705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7ea35e85-57eb-4d30-9643-3111de0052a7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:00.314445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7ea35e85-57eb-4d30-9643-3111de0052a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:00.413701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:00.420243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 692/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:00.709277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2e254-3751-4505-a746-6133cdb64ece None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:00.711063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-29f2e254-3751-4505-a746-6133cdb64ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:00.870535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:00.881938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2e254-3751-4505-a746-6133cdb64ece None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:01.006070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05c301-ab87-4110-beb2-242189f98bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:01.006835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c301-ab87-4110-beb2-242189f98bec service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:01.007417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c301-ab87-4110-beb2-242189f98bec service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:01.007795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c301-ab87-4110-beb2-242189f98bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:01.009529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3d05c301-ab87-4110-beb2-242189f98bec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:01.110086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05c301-ab87-4110-beb2-242189f98bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:01.115690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05c301-ab87-4110-beb2-242189f98bec service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:01.122926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:01.131974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 690/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:03.222594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f662-3390-4616-97e8-6a6abe31810b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:03.223156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f662-3390-4616-97e8-6a6abe31810b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:03.223156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f662-3390-4616-97e8-6a6abe31810b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:03.224513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 693/1383] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:03.229714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c74d-4be1-477c-91c6-da074c50ea29 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:03.230327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c74d-4be1-477c-91c6-da074c50ea29 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:03.230327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c74d-4be1-477c-91c6-da074c50ea29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:03.297345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ff24c74d-4be1-477c-91c6-da074c50ea29 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:03.299149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ff24c74d-4be1-477c-91c6-da074c50ea29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:03.399146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 691/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:03.690500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921f662-3390-4616-97e8-6a6abe31810b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:03.692028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e921f662-3390-4616-97e8-6a6abe31810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:03.841235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921f662-3390-4616-97e8-6a6abe31810b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:03.911379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:03.959498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916682-e4d7-4d83-89e3-cf0eb3713448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:03.960037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916682-e4d7-4d83-89e3-cf0eb3713448 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:03.960338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916682-e4d7-4d83-89e3-cf0eb3713448 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:03.960615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916682-e4d7-4d83-89e3-cf0eb3713448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:03.962210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-04916682-e4d7-4d83-89e3-cf0eb3713448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:04.054975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04916682-e4d7-4d83-89e3-cf0eb3713448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:04.056645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04916682-e4d7-4d83-89e3-cf0eb3713448 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:04.074981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 694/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:18:06.519419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2812236-bc19-4b8f-a3cd-dcd11ced7365 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:06.519962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2812236-bc19-4b8f-a3cd-dcd11ced7365 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:06.519962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2812236-bc19-4b8f-a3cd-dcd11ced7365 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:06.521357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 692/1386] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:06.528093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bba4b-2383-45d1-a928-f5b594301f3e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:06.528564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bba4b-2383-45d1-a928-f5b594301f3e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:06.528691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bba4b-2383-45d1-a928-f5b594301f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:06.597522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-842bba4b-2383-45d1-a928-f5b594301f3e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:06.598745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-842bba4b-2383-45d1-a928-f5b594301f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:06.631764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:06.704882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 695/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:06.998268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2812236-bc19-4b8f-a3cd-dcd11ced7365 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:06.999745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a2812236-bc19-4b8f-a3cd-dcd11ced7365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:07.081420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:07.153096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2812236-bc19-4b8f-a3cd-dcd11ced7365 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:07.271231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357ed54-f46d-4ed7-b142-f8b094b9d0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:07.271844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357ed54-f46d-4ed7-b142-f8b094b9d0dc service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:07.272122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357ed54-f46d-4ed7-b142-f8b094b9d0dc service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:07.272432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357ed54-f46d-4ed7-b142-f8b094b9d0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:07.274043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d357ed54-f46d-4ed7-b142-f8b094b9d0dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:07.312858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:07.365738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357ed54-f46d-4ed7-b142-f8b094b9d0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:07.367352 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357ed54-f46d-4ed7-b142-f8b094b9d0dc service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:07.385771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 693/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:09.029023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d88a-54a4-4845-9c90-4cdddfcc40f8 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:09.029577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d88a-54a4-4845-9c90-4cdddfcc40f8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:09.029577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d88a-54a4-4845-9c90-4cdddfcc40f8 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:09.030955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 696/1389] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:09.036527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f62273-839b-4b4f-a4a0-586872bc64f3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:09.036972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f62273-839b-4b4f-a4a0-586872bc64f3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:09.037078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f62273-839b-4b4f-a4a0-586872bc64f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:09.103182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-50f62273-839b-4b4f-a4a0-586872bc64f3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:09.104425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-50f62273-839b-4b4f-a4a0-586872bc64f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:09.200180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 694/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:09.430997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a86d4e-8145-474a-9792-3890fffeb7e9 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:09.431203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a86d4e-8145-474a-9792-3890fffeb7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:09.431467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a86d4e-8145-474a-9792-3890fffeb7e9 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:09.432867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 697/1391] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:09.438409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5632-2c99-46f4-bb88-c94db627d723 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:09.438803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5632-2c99-46f4-bb88-c94db627d723 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:09.438951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e5632-2c99-46f4-bb88-c94db627d723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:09.454910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:09.502728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cfaa-d1c8-4fa6-b81e-53225979f9ea None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:09.503013 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cfaa-d1c8-4fa6-b81e-53225979f9ea None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:09.503291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8cfaa-d1c8-4fa6-b81e-53225979f9ea None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:09.504802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 698/1392] 10.222.0.27 () {54 vars in 967 bytes} [Sun Aug 28 10:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:18:09.506518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d34e5632-2c99-46f4-bb88-c94db627d723 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:09.507723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d34e5632-2c99-46f4-bb88-c94db627d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:09.509430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ba349-62ab-41fb-9bf4-82b6f9891356 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:09.509723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ba349-62ab-41fb-9bf4-82b6f9891356 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:09.510000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ba349-62ab-41fb-9bf4-82b6f9891356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:09.588139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8b1ba349-62ab-41fb-9bf4-82b6f9891356 None None] MFA Rules not processed for user `00283447a1a6405b952e541a13c91110`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:09.589395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b1ba349-62ab-41fb-9bf4-82b6f9891356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:09.608128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 695/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:09.667654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 699/1394] 10.222.0.27 () {58 vars in 1064 bytes} [Sun Aug 28 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:18:09.675233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e5632-2c99-46f4-bb88-c94db627d723 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:09.676452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d34e5632-2c99-46f4-bb88-c94db627d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:09.786713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e5632-2c99-46f4-bb88-c94db627d723 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:09.792280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:09.868671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea7027-dc55-42b2-bc4c-c59b49a1d454 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00283447a1a6405b952e541a13c91110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:09.869286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7027-dc55-42b2-bc4c-c59b49a1d454 service glance] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:09.869567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7027-dc55-42b2-bc4c-c59b49a1d454 service glance] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:09.869842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea7027-dc55-42b2-bc4c-c59b49a1d454 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:09.871446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-95ea7027-dc55-42b2-bc4c-c59b49a1d454 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:09.910974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ba349-62ab-41fb-9bf4-82b6f9891356 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:09.912248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b1ba349-62ab-41fb-9bf4-82b6f9891356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:09.947315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:09.992586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea7027-dc55-42b2-bc4c-c59b49a1d454 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:09.994040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea7027-dc55-42b2-bc4c-c59b49a1d454 service glance] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:10.014139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 696/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:10.048330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ba349-62ab-41fb-9bf4-82b6f9891356 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:10.175347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a508-0c31-4ffa-ab5e-cf7f4c4dd562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:10.176052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a508-0c31-4ffa-ab5e-cf7f4c4dd562 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:10.176444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a508-0c31-4ffa-ab5e-cf7f4c4dd562 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:10.176806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a508-0c31-4ffa-ab5e-cf7f4c4dd562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:10.178769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c96a508-0c31-4ffa-ab5e-cf7f4c4dd562 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:10.201737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:10.281949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a508-0c31-4ffa-ab5e-cf7f4c4dd562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:10.283588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a508-0c31-4ffa-ab5e-cf7f4c4dd562 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:10.305021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 700/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:18:10.984546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9fe6-7e49-41c5-8300-41db4a474e18 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:10.985586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9fe6-7e49-41c5-8300-41db4a474e18 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:10.985839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9fe6-7e49-41c5-8300-41db4a474e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:11.033375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:11.055585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-055c9fe6-7e49-41c5-8300-41db4a474e18 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:11.056825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-055c9fe6-7e49-41c5-8300-41db4a474e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:11.146355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 697/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:18:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:11.190563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337d075-03ce-481f-bf0b-c5ebc077a8b2 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:11.191073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337d075-03ce-481f-bf0b-c5ebc077a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:11.191326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337d075-03ce-481f-bf0b-c5ebc077a8b2 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:11.192808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 701/1398] 10.222.0.27 () {54 vars in 943 bytes} [Sun Aug 28 10:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:11.199248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d313e-833a-49ed-aca8-7d7efc4e57f3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:11.199602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d313e-833a-49ed-aca8-7d7efc4e57f3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:11.199942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d313e-833a-49ed-aca8-7d7efc4e57f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:11.274787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-261d313e-833a-49ed-aca8-7d7efc4e57f3 None None] MFA Rules not processed for user `00dd24daa5374b85adbca9b16b807537`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:11.276164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-261d313e-833a-49ed-aca8-7d7efc4e57f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:11.336556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:11.382306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 698/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Sun Aug 28 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:11.392484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337d075-03ce-481f-bf0b-c5ebc077a8b2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:11.394089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2337d075-03ce-481f-bf0b-c5ebc077a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:11.534875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337d075-03ce-481f-bf0b-c5ebc077a8b2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:11.544617 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:11.640440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62e45c-2212-42a3-9788-38f5a4235dc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:11.641105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62e45c-2212-42a3-9788-38f5a4235dc1 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:11.641869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62e45c-2212-42a3-9788-38f5a4235dc1 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:11.642226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62e45c-2212-42a3-9788-38f5a4235dc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:11.643856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2d62e45c-2212-42a3-9788-38f5a4235dc1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:11.725963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62e45c-2212-42a3-9788-38f5a4235dc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:11.727655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62e45c-2212-42a3-9788-38f5a4235dc1 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:11.736544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 702/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:18:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:18:12.436575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf78bc-ab36-4cd8-883d-7c1b13a17a18 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:12.437151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf78bc-ab36-4cd8-883d-7c1b13a17a18 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:12.437151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf78bc-ab36-4cd8-883d-7c1b13a17a18 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:12.439127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 699/1401] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:12.444533 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ca99-85b1-4f3e-88b7-6e508e98788c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:12.444999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ca99-85b1-4f3e-88b7-6e508e98788c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:12.445102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ca99-85b1-4f3e-88b7-6e508e98788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:12.496402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:12.518453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5fe0ca99-85b1-4f3e-88b7-6e508e98788c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:12.519695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5fe0ca99-85b1-4f3e-88b7-6e508e98788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:12.627705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 703/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:12.923214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf78bc-ab36-4cd8-883d-7c1b13a17a18 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:12.924816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8bcf78bc-ab36-4cd8-883d-7c1b13a17a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:13.090784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf78bc-ab36-4cd8-883d-7c1b13a17a18 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:13.137507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:13.243945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf458092-a154-4ac5-a37f-f5d2dba2427f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:13.244780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458092-a154-4ac5-a37f-f5d2dba2427f service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:13.245151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458092-a154-4ac5-a37f-f5d2dba2427f service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:13.246131 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf458092-a154-4ac5-a37f-f5d2dba2427f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:13.247889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf458092-a154-4ac5-a37f-f5d2dba2427f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:13.354449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf458092-a154-4ac5-a37f-f5d2dba2427f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:13.356346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf458092-a154-4ac5-a37f-f5d2dba2427f service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:13.384142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 700/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:15.521506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7086f8-260c-460d-970d-1cf3548a596f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:15.522056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7086f8-260c-460d-970d-1cf3548a596f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:15.522056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7086f8-260c-460d-970d-1cf3548a596f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:15.523573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 704/1404] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:15.530108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8e2b0-be4c-4360-bb89-13ab409b0c7a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:15.531008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8e2b0-be4c-4360-bb89-13ab409b0c7a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:15.531314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8e2b0-be4c-4360-bb89-13ab409b0c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:15.607882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:15.622125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-07c8e2b0-be4c-4360-bb89-13ab409b0c7a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:15.623484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-07c8e2b0-be4c-4360-bb89-13ab409b0c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:15.745246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 701/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:16.042818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7086f8-260c-460d-970d-1cf3548a596f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:16.044561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ee7086f8-260c-460d-970d-1cf3548a596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:16.187446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:16.224193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7086f8-260c-460d-970d-1cf3548a596f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:16.349710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496978-d0ec-433e-ad79-70e36d59b2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:16.350302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496978-d0ec-433e-ad79-70e36d59b2b0 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:16.350583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496978-d0ec-433e-ad79-70e36d59b2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:16.350855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496978-d0ec-433e-ad79-70e36d59b2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:16.352465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5c496978-d0ec-433e-ad79-70e36d59b2b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:16.443200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:16.455285 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c496978-d0ec-433e-ad79-70e36d59b2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:16.456979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c496978-d0ec-433e-ad79-70e36d59b2b0 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:16.477564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 705/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:18.607479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1734d2-bdad-4da7-89ba-4c04803aa571 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:18.608014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1734d2-bdad-4da7-89ba-4c04803aa571 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:18.608014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1734d2-bdad-4da7-89ba-4c04803aa571 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:18.609416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 702/1407] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:18.615246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9bad1-d4d3-4747-9549-bebdff6f9d7c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:18.615681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9bad1-d4d3-4747-9549-bebdff6f9d7c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:18.615826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9bad1-d4d3-4747-9549-bebdff6f9d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:18.689060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-77a9bad1-d4d3-4747-9549-bebdff6f9d7c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:18.690271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-77a9bad1-d4d3-4747-9549-bebdff6f9d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:18.800956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 706/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:19.098017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1734d2-bdad-4da7-89ba-4c04803aa571 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:19.099604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5f1734d2-bdad-4da7-89ba-4c04803aa571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:19.228903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:19.259804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1734d2-bdad-4da7-89ba-4c04803aa571 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:19.390439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60000725-c04b-49ab-8f3f-0047a182e4d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:19.391155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60000725-c04b-49ab-8f3f-0047a182e4d2 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:19.391430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60000725-c04b-49ab-8f3f-0047a182e4d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:19.391730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60000725-c04b-49ab-8f3f-0047a182e4d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:19.393372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-60000725-c04b-49ab-8f3f-0047a182e4d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:19.490134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:19.493603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60000725-c04b-49ab-8f3f-0047a182e4d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:19.495309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60000725-c04b-49ab-8f3f-0047a182e4d2 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:19.515064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 703/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:28.798404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=74 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:29.522542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:35.535780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef60c7-5609-4ac6-aaab-5fa8b5608980 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:35.536371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef60c7-5609-4ac6-aaab-5fa8b5608980 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:35.536371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef60c7-5609-4ac6-aaab-5fa8b5608980 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:35.537753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 707/1410] 10.222.0.27 () {54 vars in 918 bytes} [Sun Aug 28 10:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:35.542916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c343-a41f-4e40-a6ca-634d936fd043 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:35.543339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c343-a41f-4e40-a6ca-634d936fd043 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:35.543462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8c343-a41f-4e40-a6ca-634d936fd043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:35.618377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a7b8c343-a41f-4e40-a6ca-634d936fd043 None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:35.619573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a7b8c343-a41f-4e40-a6ca-634d936fd043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:35.723943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 704/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Aug 28 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:35.743343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47261fa-4edb-48f5-9ccd-5e697ee802f1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:35.743681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47261fa-4edb-48f5-9ccd-5e697ee802f1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:35.743993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47261fa-4edb-48f5-9ccd-5e697ee802f1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:35.745652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 708/1412] 10.222.0.27 () {54 vars in 918 bytes} [Sun Aug 28 10:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:35.752494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50782ab-4fbf-4015-ad02-13a837ba6c5e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:35.752992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50782ab-4fbf-4015-ad02-13a837ba6c5e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:35.753443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50782ab-4fbf-4015-ad02-13a837ba6c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:35.834565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:35.837053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e50782ab-4fbf-4015-ad02-13a837ba6c5e None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:35.838372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e50782ab-4fbf-4015-ad02-13a837ba6c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:35.972417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 705/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Aug 28 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:38.380035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fec8d-c49a-40b4-8f67-e5ef8f4dc731 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:38.380605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fec8d-c49a-40b4-8f67-e5ef8f4dc731 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:38.380605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fec8d-c49a-40b4-8f67-e5ef8f4dc731 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:38.381925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:38.387223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25de1-80d5-48f5-96b4-4eacac54c75f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:38.387607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25de1-80d5-48f5-96b4-4eacac54c75f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:38.387697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a25de1-80d5-48f5-96b4-4eacac54c75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:38.452178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e6a25de1-80d5-48f5-96b4-4eacac54c75f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:38.454019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e6a25de1-80d5-48f5-96b4-4eacac54c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:38.507286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:38.549266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:38.838377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fec8d-c49a-40b4-8f67-e5ef8f4dc731 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:38.839887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ba6fec8d-c49a-40b4-8f67-e5ef8f4dc731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:38.982970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fec8d-c49a-40b4-8f67-e5ef8f4dc731 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:39.055627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:39.095957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e7b2-f2c5-4ae7-aa97-491db1dd66a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:39.096534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e7b2-f2c5-4ae7-aa97-491db1dd66a8 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:39.096813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e7b2-f2c5-4ae7-aa97-491db1dd66a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:39.097087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e7b2-f2c5-4ae7-aa97-491db1dd66a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:39.098684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b280e7b2-f2c5-4ae7-aa97-491db1dd66a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:39.187740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280e7b2-f2c5-4ae7-aa97-491db1dd66a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:39.189355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280e7b2-f2c5-4ae7-aa97-491db1dd66a8 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:39.206875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 710/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:40.104438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff02051-2a2b-4fb9-9fbc-f4b4e4a266cd None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:40.104985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff02051-2a2b-4fb9-9fbc-f4b4e4a266cd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:40.104985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff02051-2a2b-4fb9-9fbc-f4b4e4a266cd None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:40.106374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:40.111467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4249b-50e2-4c83-b70f-217d0d5687d9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:40.111913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4249b-50e2-4c83-b70f-217d0d5687d9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:40.112028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4249b-50e2-4c83-b70f-217d0d5687d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:40.188575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e1f4249b-50e2-4c83-b70f-217d0d5687d9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:40.189776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e1f4249b-50e2-4c83-b70f-217d0d5687d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:40.216424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:40.285997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:40.435998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff02051-2a2b-4fb9-9fbc-f4b4e4a266cd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:40.437611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fff02051-2a2b-4fb9-9fbc-f4b4e4a266cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:40.583193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff02051-2a2b-4fb9-9fbc-f4b4e4a266cd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:40.623122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:40.695297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb7080-a601-4b2d-b8bc-9c8dd2736fc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:40.695823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7080-a601-4b2d-b8bc-9c8dd2736fc7 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:40.696098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7080-a601-4b2d-b8bc-9c8dd2736fc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:40.696399 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7080-a601-4b2d-b8bc-9c8dd2736fc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:40.697975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-edbb7080-a601-4b2d-b8bc-9c8dd2736fc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:40.786056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb7080-a601-4b2d-b8bc-9c8dd2736fc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:40.787628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb7080-a601-4b2d-b8bc-9c8dd2736fc7 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:40.805125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 708/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:41.703544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed5b1-6074-4d53-8dbf-f900260e75bf None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:41.704219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed5b1-6074-4d53-8dbf-f900260e75bf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:41.704219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aed5b1-6074-4d53-8dbf-f900260e75bf None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:41.705487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:41.710275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209126-c11f-4c03-9390-a042339f1084 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:41.710683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209126-c11f-4c03-9390-a042339f1084 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:41.710817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff209126-c11f-4c03-9390-a042339f1084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:41.763550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:41.785102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ff209126-c11f-4c03-9390-a042339f1084 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:41.786297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ff209126-c11f-4c03-9390-a042339f1084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:41.882472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:42.035432 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aed5b1-6074-4d53-8dbf-f900260e75bf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:42.036946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-40aed5b1-6074-4d53-8dbf-f900260e75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:42.182979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aed5b1-6074-4d53-8dbf-f900260e75bf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:42.195666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:42.295851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c9e3e-f0bc-4e00-ba64-9455320d4bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:42.296491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9e3e-f0bc-4e00-ba64-9455320d4bd9 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:42.296936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9e3e-f0bc-4e00-ba64-9455320d4bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:42.297211 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9e3e-f0bc-4e00-ba64-9455320d4bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:42.298808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f75c9e3e-f0bc-4e00-ba64-9455320d4bd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:42.386198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c9e3e-f0bc-4e00-ba64-9455320d4bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:42.387777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c9e3e-f0bc-4e00-ba64-9455320d4bd9 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:42.406364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 713/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:43.270249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f4ca-37c4-4e52-bf59-ba79198b5f31 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:43.270812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f4ca-37c4-4e52-bf59-ba79198b5f31 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:43.270812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f4ca-37c4-4e52-bf59-ba79198b5f31 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:43.272152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:43.277498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917dd0-3ff1-403a-8b36-14ef91256562 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:43.277930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917dd0-3ff1-403a-8b36-14ef91256562 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:43.278028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c917dd0-3ff1-403a-8b36-14ef91256562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:43.298621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:43.355923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7c917dd0-3ff1-403a-8b36-14ef91256562 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:43.357148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7c917dd0-3ff1-403a-8b36-14ef91256562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:43.452777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:43.602820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4f4ca-37c4-4e52-bf59-ba79198b5f31 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:43.604348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4ad4f4ca-37c4-4e52-bf59-ba79198b5f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:43.709826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:43.744840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4f4ca-37c4-4e52-bf59-ba79198b5f31 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:43.854827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ecb5-a90d-4bbd-a55a-fdccc3e7e02d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:43.855369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ecb5-a90d-4bbd-a55a-fdccc3e7e02d service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:43.855644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ecb5-a90d-4bbd-a55a-fdccc3e7e02d service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:43.855913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ecb5-a90d-4bbd-a55a-fdccc3e7e02d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:43.857515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f70ecb5-a90d-4bbd-a55a-fdccc3e7e02d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:43.932557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:43.945513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ecb5-a90d-4bbd-a55a-fdccc3e7e02d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:43.947091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ecb5-a90d-4bbd-a55a-fdccc3e7e02d service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:43.965200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 711/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:44.819191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421176-61fb-4b11-a6ae-ad8bb3846949 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:44.819776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421176-61fb-4b11-a6ae-ad8bb3846949 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:44.819776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421176-61fb-4b11-a6ae-ad8bb3846949 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:44.821097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:44.825980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4285-68b1-4d8e-b2a3-d1cd3d703a36 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:44.826468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4285-68b1-4d8e-b2a3-d1cd3d703a36 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:44.826610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e4285-68b1-4d8e-b2a3-d1cd3d703a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:44.905081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f74e4285-68b1-4d8e-b2a3-d1cd3d703a36 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:44.908712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f74e4285-68b1-4d8e-b2a3-d1cd3d703a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:45.003789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:18:45.153153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9421176-61fb-4b11-a6ae-ad8bb3846949 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:45.154706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f9421176-61fb-4b11-a6ae-ad8bb3846949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:45.239865 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:45.302587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9421176-61fb-4b11-a6ae-ad8bb3846949 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:45.415073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cfe70-8bbc-4cf1-ab11-eb0c5f912276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:45.415598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cfe70-8bbc-4cf1-ab11-eb0c5f912276 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:45.415872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cfe70-8bbc-4cf1-ab11-eb0c5f912276 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:45.416138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cfe70-8bbc-4cf1-ab11-eb0c5f912276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:45.417766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4d1cfe70-8bbc-4cf1-ab11-eb0c5f912276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:45.465589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:45.507128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cfe70-8bbc-4cf1-ab11-eb0c5f912276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:45.508766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cfe70-8bbc-4cf1-ab11-eb0c5f912276 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:45.527292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 716/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:46.398156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9592-d942-4e0c-b3e9-19f7323a2163 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:46.398783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9592-d942-4e0c-b3e9-19f7323a2163 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:46.398783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d9592-d942-4e0c-b3e9-19f7323a2163 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:46.400323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:46.405682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debbf6-3a79-4f0e-a5b9-7246c27ee554 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:46.406263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debbf6-3a79-4f0e-a5b9-7246c27ee554 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:46.406263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debbf6-3a79-4f0e-a5b9-7246c27ee554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:46.484526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-72debbf6-3a79-4f0e-a5b9-7246c27ee554 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:46.485734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-72debbf6-3a79-4f0e-a5b9-7246c27ee554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:46.580914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:18:46.732952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d9592-d942-4e0c-b3e9-19f7323a2163 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:46.735048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d20d9592-d942-4e0c-b3e9-19f7323a2163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:46.782247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:46.879918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d9592-d942-4e0c-b3e9-19f7323a2163 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:46.993048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40ed7f-71c3-4283-879b-63af96698452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:46.993583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ed7f-71c3-4283-879b-63af96698452 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:46.993860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ed7f-71c3-4283-879b-63af96698452 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:46.994130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40ed7f-71c3-4283-879b-63af96698452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:46.995742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9a40ed7f-71c3-4283-879b-63af96698452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:47.002735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:47.088258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40ed7f-71c3-4283-879b-63af96698452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:47.089891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40ed7f-71c3-4283-879b-63af96698452 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:47.107761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 714/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:48.005520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc676b6-5924-4e99-8530-0248890b1257 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:48.006033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc676b6-5924-4e99-8530-0248890b1257 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:48.006143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc676b6-5924-4e99-8530-0248890b1257 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:48.007397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:48.012488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdb0b-acfe-422d-8267-21f3b525e590 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:48.012926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdb0b-acfe-422d-8267-21f3b525e590 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:48.013037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cdb0b-acfe-422d-8267-21f3b525e590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:48.092669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-215cdb0b-acfe-422d-8267-21f3b525e590 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:48.092669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-215cdb0b-acfe-422d-8267-21f3b525e590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:48.164301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:48.193559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:18:48.348070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc676b6-5924-4e99-8530-0248890b1257 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:48.349556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0fc676b6-5924-4e99-8530-0248890b1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:48.367177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:48.494688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc676b6-5924-4e99-8530-0248890b1257 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:48.580797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:48.605508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09581406-0373-4eba-af93-fc52d2201dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:48.606114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581406-0373-4eba-af93-fc52d2201dc2 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:48.606397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581406-0373-4eba-af93-fc52d2201dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:48.606672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09581406-0373-4eba-af93-fc52d2201dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:48.608268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-09581406-0373-4eba-af93-fc52d2201dc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:48.697285 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09581406-0373-4eba-af93-fc52d2201dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:48.698898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09581406-0373-4eba-af93-fc52d2201dc2 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:48.716371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 719/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:49.616994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e346-b341-4ae9-b02d-5d131ba9b6d1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:49.617595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e346-b341-4ae9-b02d-5d131ba9b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:49.617595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e346-b341-4ae9-b02d-5d131ba9b6d1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:49.618878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:49.623819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa1e3-7fd1-4107-bf3f-289c920d8856 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:49.624858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa1e3-7fd1-4107-bf3f-289c920d8856 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:49.624858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afa1e3-7fd1-4107-bf3f-289c920d8856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:49.699604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b0afa1e3-7fd1-4107-bf3f-289c920d8856 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:49.700815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b0afa1e3-7fd1-4107-bf3f-289c920d8856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:49.741661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:49.796263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:49.946573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e346-b341-4ae9-b02d-5d131ba9b6d1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:49.947997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7073e346-b341-4ae9-b02d-5d131ba9b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:50.091680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e346-b341-4ae9-b02d-5d131ba9b6d1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:50.145905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:50.203878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a80a2-968f-43ff-ba7d-bf4c99d15f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:50.204435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a80a2-968f-43ff-ba7d-bf4c99d15f48 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:50.204719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a80a2-968f-43ff-ba7d-bf4c99d15f48 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:50.204991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a80a2-968f-43ff-ba7d-bf4c99d15f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:50.206589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-631a80a2-968f-43ff-ba7d-bf4c99d15f48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:50.294047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a80a2-968f-43ff-ba7d-bf4c99d15f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:50.295640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a80a2-968f-43ff-ba7d-bf4c99d15f48 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:50.313931 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 717/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:51.211727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3915d5-1e74-45be-9180-acaef57fbb33 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:51.212276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3915d5-1e74-45be-9180-acaef57fbb33 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:51.212276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3915d5-1e74-45be-9180-acaef57fbb33 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:51.213645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:51.219093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4cd8-2278-4e87-b5a3-401dedfe1006 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:51.219488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4cd8-2278-4e87-b5a3-401dedfe1006 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:51.219636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4cd8-2278-4e87-b5a3-401dedfe1006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:51.295145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a01b4cd8-2278-4e87-b5a3-401dedfe1006 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:51.297047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a01b4cd8-2278-4e87-b5a3-401dedfe1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:51.299033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:51.392015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:51.547291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3915d5-1e74-45be-9180-acaef57fbb33 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:51.548764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cf3915d5-1e74-45be-9180-acaef57fbb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:51.693731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3915d5-1e74-45be-9180-acaef57fbb33 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:51.721558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:51.806521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a713eb6-584d-4091-b322-5dee1e4cc66a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:51.807042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713eb6-584d-4091-b322-5dee1e4cc66a service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:51.807319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713eb6-584d-4091-b322-5dee1e4cc66a service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:51.807586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713eb6-584d-4091-b322-5dee1e4cc66a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:51.809194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4a713eb6-584d-4091-b322-5dee1e4cc66a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:51.900241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a713eb6-584d-4091-b322-5dee1e4cc66a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:51.901839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a713eb6-584d-4091-b322-5dee1e4cc66a service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:51.919703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 722/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:53.757568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc7882-ce06-47ec-be73-d973ec22f9c9 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:53.758137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc7882-ce06-47ec-be73-d973ec22f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:53.758137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc7882-ce06-47ec-be73-d973ec22f9c9 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:53.759452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:53.765072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb812-c8a3-46c7-a11c-a73c65b3a9be None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:53.765515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb812-c8a3-46c7-a11c-a73c65b3a9be None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:53.765630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bb812-c8a3-46c7-a11c-a73c65b3a9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:53.805966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:53.831692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fe1bb812-c8a3-46c7-a11c-a73c65b3a9be None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:53.833006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fe1bb812-c8a3-46c7-a11c-a73c65b3a9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:53.930547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:54.217299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc7882-ce06-47ec-be73-d973ec22f9c9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:54.219144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bdfc7882-ce06-47ec-be73-d973ec22f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:54.326365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc7882-ce06-47ec-be73-d973ec22f9c9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:54.360026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:54.401279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa647-66d8-4c2e-9025-13e8380ce7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:54.401885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa647-66d8-4c2e-9025-13e8380ce7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:54.402164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa647-66d8-4c2e-9025-13e8380ce7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:54.402435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa647-66d8-4c2e-9025-13e8380ce7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:54.404037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-735fa647-66d8-4c2e-9025-13e8380ce7e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:54.511332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa647-66d8-4c2e-9025-13e8380ce7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:54.512736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa647-66d8-4c2e-9025-13e8380ce7e8 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:54.531987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 720/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:56.585005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9004-8cfb-4e34-9f2b-100d8a281966 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:56.585537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9004-8cfb-4e34-9f2b-100d8a281966 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:56.585537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea9004-8cfb-4e34-9f2b-100d8a281966 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:56.586797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:56.592134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791038-b7da-44f9-9ca9-4446de013b1e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:56.592636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791038-b7da-44f9-9ca9-4446de013b1e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:56.592847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791038-b7da-44f9-9ca9-4446de013b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:56.657833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-01791038-b7da-44f9-9ca9-4446de013b1e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:56.659047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-01791038-b7da-44f9-9ca9-4446de013b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:56.671617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:56.755052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:18:57.040919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea9004-8cfb-4e34-9f2b-100d8a281966 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:18:57.042438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e1ea9004-8cfb-4e34-9f2b-100d8a281966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:57.146236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea9004-8cfb-4e34-9f2b-100d8a281966 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:18:57.159112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:57.219444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3a9d1-4fe4-4196-aaf9-b877276faf53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:18:57.220049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3a9d1-4fe4-4196-aaf9-b877276faf53 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:57.220359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3a9d1-4fe4-4196-aaf9-b877276faf53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:57.220638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3a9d1-4fe4-4196-aaf9-b877276faf53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:57.222227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d5c3a9d1-4fe4-4196-aaf9-b877276faf53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:57.331799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3a9d1-4fe4-4196-aaf9-b877276faf53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:18:57.333181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3a9d1-4fe4-4196-aaf9-b877276faf53 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:18:57.352054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 725/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:18:59.618995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020182bc-53ec-43b9-a017-5fbe4eec141c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:59.619576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020182bc-53ec-43b9-a017-5fbe4eec141c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:59.619576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020182bc-53ec-43b9-a017-5fbe4eec141c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:59.620922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:18:59.626822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f818c-4d78-4dc4-a551-708e09d372bf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:18:59.627275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f818c-4d78-4dc4-a551-708e09d372bf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:18:59.627389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f818c-4d78-4dc4-a551-708e09d372bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:18:59.675936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:18:59.694035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d08f818c-4d78-4dc4-a551-708e09d372bf None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:18:59.695235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d08f818c-4d78-4dc4-a551-708e09d372bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:18:59.791926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:00.078166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020182bc-53ec-43b9-a017-5fbe4eec141c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:00.079701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-020182bc-53ec-43b9-a017-5fbe4eec141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:00.182878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020182bc-53ec-43b9-a017-5fbe4eec141c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:00.222615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:00.256599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd64ab-10fe-4945-8a69-9e5df701cb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:00.257210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd64ab-10fe-4945-8a69-9e5df701cb40 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:00.257490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd64ab-10fe-4945-8a69-9e5df701cb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:00.257762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd64ab-10fe-4945-8a69-9e5df701cb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:00.259371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e8bd64ab-10fe-4945-8a69-9e5df701cb40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:00.367303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd64ab-10fe-4945-8a69-9e5df701cb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:00.368772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd64ab-10fe-4945-8a69-9e5df701cb40 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:00.387443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 723/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:02.442456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8990-6adc-4f4b-9838-74adb4b57f88 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:02.443011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8990-6adc-4f4b-9838-74adb4b57f88 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:02.443011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8990-6adc-4f4b-9838-74adb4b57f88 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:02.444371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:02.449695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a44e1-0c64-4df5-a625-91262147fcbb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:02.450144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a44e1-0c64-4df5-a625-91262147fcbb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:02.450315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a44e1-0c64-4df5-a625-91262147fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:02.516127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-395a44e1-0c64-4df5-a625-91262147fcbb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:02.517357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-395a44e1-0c64-4df5-a625-91262147fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:02.538260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:02.614145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:02.905709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8990-6adc-4f4b-9838-74adb4b57f88 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:02.907227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d14f8990-6adc-4f4b-9838-74adb4b57f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:03.011081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8990-6adc-4f4b-9838-74adb4b57f88 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:03.032546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:03.086576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4168-9864-489e-850f-1a93ebcb06a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:03.087103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4168-9864-489e-850f-1a93ebcb06a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:03.087380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4168-9864-489e-850f-1a93ebcb06a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:03.087686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4168-9864-489e-850f-1a93ebcb06a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:03.089295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-685b4168-9864-489e-850f-1a93ebcb06a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:03.198235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b4168-9864-489e-850f-1a93ebcb06a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:03.199656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b4168-9864-489e-850f-1a93ebcb06a9 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:03.219094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 728/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:05.297174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e37fb-d8ce-4d76-8626-1aefb2b0a602 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:05.297756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e37fb-d8ce-4d76-8626-1aefb2b0a602 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:05.297756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e37fb-d8ce-4d76-8626-1aefb2b0a602 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:05.299142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:05.304521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b566ea-344d-449b-b081-aa200d6126ee None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:05.304961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b566ea-344d-449b-b081-aa200d6126ee None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:05.305072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b566ea-344d-449b-b081-aa200d6126ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:05.370690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:05.373510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f5b566ea-344d-449b-b081-aa200d6126ee None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:05.374729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f5b566ea-344d-449b-b081-aa200d6126ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:05.469838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:05.760459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e37fb-d8ce-4d76-8626-1aefb2b0a602 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:05.761990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae0e37fb-d8ce-4d76-8626-1aefb2b0a602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:05.865885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e37fb-d8ce-4d76-8626-1aefb2b0a602 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:05.914745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:05.938629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f4676-a997-4f0d-945d-5a9873195da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:05.942488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f4676-a997-4f0d-945d-5a9873195da0 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:05.942488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f4676-a997-4f0d-945d-5a9873195da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:05.942488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f4676-a997-4f0d-945d-5a9873195da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:05.942488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7e0f4676-a997-4f0d-945d-5a9873195da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:06.050163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f4676-a997-4f0d-945d-5a9873195da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:06.051531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f4676-a997-4f0d-945d-5a9873195da0 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:06.070280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 726/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:08.100538 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ba1b-ea76-4366-a317-bce18774afe0 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:08.101073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ba1b-ea76-4366-a317-bce18774afe0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:08.101073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6ba1b-ea76-4366-a317-bce18774afe0 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:08.102345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:08.108193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e351-bd31-4013-b99a-36dff35fcf8c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:08.108667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e351-bd31-4013-b99a-36dff35fcf8c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:08.108826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e351-bd31-4013-b99a-36dff35fcf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:08.174370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c091e351-bd31-4013-b99a-36dff35fcf8c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:08.175574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c091e351-bd31-4013-b99a-36dff35fcf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:08.204675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:08.272770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:08.561011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6ba1b-ea76-4366-a317-bce18774afe0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:08.562760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-94d6ba1b-ea76-4366-a317-bce18774afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:08.665494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6ba1b-ea76-4366-a317-bce18774afe0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:08.693707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:08.739352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1276d-2c29-4901-acd6-5a81b9b73565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:08.739947 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1276d-2c29-4901-acd6-5a81b9b73565 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:08.740223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1276d-2c29-4901-acd6-5a81b9b73565 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:08.740524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1276d-2c29-4901-acd6-5a81b9b73565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:08.742091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31c1276d-2c29-4901-acd6-5a81b9b73565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:08.850496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1276d-2c29-4901-acd6-5a81b9b73565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:08.851934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1276d-2c29-4901-acd6-5a81b9b73565 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:08.870554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 731/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:10.842507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a571273-78a8-43f1-ba43-c912b473ac81 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:10.842918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a571273-78a8-43f1-ba43-c912b473ac81 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:10.843100 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a571273-78a8-43f1-ba43-c912b473ac81 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:10.844534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:10.849935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478e7c6-b42f-42e7-b77b-df8c93b7bec0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:10.850366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478e7c6-b42f-42e7-b77b-df8c93b7bec0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:10.850464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478e7c6-b42f-42e7-b77b-df8c93b7bec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:10.917455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a478e7c6-b42f-42e7-b77b-df8c93b7bec0 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:10.918665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a478e7c6-b42f-42e7-b77b-df8c93b7bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:10.927749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:11.016792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:11.306375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a571273-78a8-43f1-ba43-c912b473ac81 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:11.307959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2a571273-78a8-43f1-ba43-c912b473ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:11.411298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a571273-78a8-43f1-ba43-c912b473ac81 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:11.465009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:11.484166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aab983-fcaf-4e95-9764-7ab462ce6058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:11.484810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab983-fcaf-4e95-9764-7ab462ce6058 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:11.485090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab983-fcaf-4e95-9764-7ab462ce6058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:11.485363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aab983-fcaf-4e95-9764-7ab462ce6058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:11.486995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30aab983-fcaf-4e95-9764-7ab462ce6058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:11.594475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aab983-fcaf-4e95-9764-7ab462ce6058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:11.595826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aab983-fcaf-4e95-9764-7ab462ce6058 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:11.614181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 729/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:13.737712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37892b9-53dc-442c-88d0-a6f15104f966 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:13.738325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37892b9-53dc-442c-88d0-a6f15104f966 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:13.738325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37892b9-53dc-442c-88d0-a6f15104f966 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:13.739612 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:13.745021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0b47-b537-4e2d-928f-c6fb4293686c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:13.745434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0b47-b537-4e2d-928f-c6fb4293686c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:13.745570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0b47-b537-4e2d-928f-c6fb4293686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:13.811938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-938c0b47-b537-4e2d-928f-c6fb4293686c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:13.813171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-938c0b47-b537-4e2d-928f-c6fb4293686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:13.858602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:13.918564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:14.209334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37892b9-53dc-442c-88d0-a6f15104f966 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:14.210864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c37892b9-53dc-442c-88d0-a6f15104f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:14.315201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37892b9-53dc-442c-88d0-a6f15104f966 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:14.353385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:14.390020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db10797-ee4a-4db3-84e6-b9c2dad5cd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:14.390628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10797-ee4a-4db3-84e6-b9c2dad5cd94 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:14.390975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10797-ee4a-4db3-84e6-b9c2dad5cd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:14.391253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db10797-ee4a-4db3-84e6-b9c2dad5cd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:14.392880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8db10797-ee4a-4db3-84e6-b9c2dad5cd94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:14.499979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db10797-ee4a-4db3-84e6-b9c2dad5cd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:14.501366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db10797-ee4a-4db3-84e6-b9c2dad5cd94 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:14.519834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 734/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:16.484911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b7f7-0c73-4d1f-9152-c58903bcbde1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:16.485439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b7f7-0c73-4d1f-9152-c58903bcbde1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:16.485439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b7f7-0c73-4d1f-9152-c58903bcbde1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:16.486729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:16.492136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394416-c95f-4991-9e54-03fa37b34f75 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:16.492578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394416-c95f-4991-9e54-03fa37b34f75 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:16.492733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394416-c95f-4991-9e54-03fa37b34f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:16.560711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-75394416-c95f-4991-9e54-03fa37b34f75 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:16.561927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-75394416-c95f-4991-9e54-03fa37b34f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:16.580550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:16.658956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:16.941223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0b7f7-0c73-4d1f-9152-c58903bcbde1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:16.942763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-95e0b7f7-0c73-4d1f-9152-c58903bcbde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:17.046851 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0b7f7-0c73-4d1f-9152-c58903bcbde1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:17.113821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:17.120387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79c4be-d4d1-42f1-a2c6-f6ef7ced8d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:17.120992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c4be-d4d1-42f1-a2c6-f6ef7ced8d90 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:17.121266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c4be-d4d1-42f1-a2c6-f6ef7ced8d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:17.121534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c4be-d4d1-42f1-a2c6-f6ef7ced8d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:17.123341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf79c4be-d4d1-42f1-a2c6-f6ef7ced8d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:17.232082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79c4be-d4d1-42f1-a2c6-f6ef7ced8d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:17.233769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79c4be-d4d1-42f1-a2c6-f6ef7ced8d90 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:17.251500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 732/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:19.166360 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a0f8-aa39-4719-9a96-3a51d20ed6d4 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:19.166930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a0f8-aa39-4719-9a96-3a51d20ed6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:19.166930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227a0f8-aa39-4719-9a96-3a51d20ed6d4 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:19.168316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:19.174266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b906f7-93af-4ea5-88c7-57216ff62121 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:19.174730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b906f7-93af-4ea5-88c7-57216ff62121 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:19.174826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b906f7-93af-4ea5-88c7-57216ff62121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:19.240606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-29b906f7-93af-4ea5-88c7-57216ff62121 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:19.241821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-29b906f7-93af-4ea5-88c7-57216ff62121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:19.291795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:19.339676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:19.623901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227a0f8-aa39-4719-9a96-3a51d20ed6d4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:19.625478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3227a0f8-aa39-4719-9a96-3a51d20ed6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:19.728050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227a0f8-aa39-4719-9a96-3a51d20ed6d4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:19.775504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:19.801336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd1f06-f678-406f-a756-bb2f4884cae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:19.801937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd1f06-f678-406f-a756-bb2f4884cae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:19.802216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd1f06-f678-406f-a756-bb2f4884cae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:19.802485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd1f06-f678-406f-a756-bb2f4884cae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:19.804069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9efd1f06-f678-406f-a756-bb2f4884cae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:19.913618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd1f06-f678-406f-a756-bb2f4884cae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:19.914967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd1f06-f678-406f-a756-bb2f4884cae7 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:19.933036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 737/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:29.337903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=22 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:29.930750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=66 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:39.539864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9828a3a-2339-4d46-9c9c-efdd43ec23c6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:39.540457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9828a3a-2339-4d46-9c9c-efdd43ec23c6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:39.540457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9828a3a-2339-4d46-9c9c-efdd43ec23c6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:39.541819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 734/1471] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:39.547824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e4d3-471e-4952-b4a8-08614227ff76 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:39.548244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e4d3-471e-4952-b4a8-08614227ff76 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:39.548403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5e4d3-471e-4952-b4a8-08614227ff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:39.612615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8bc5e4d3-471e-4952-b4a8-08614227ff76 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:39.613811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8bc5e4d3-471e-4952-b4a8-08614227ff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:39.714601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 738/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:40.017162 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8229-f3fc-4362-a430-08dc7c41418b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:40.017438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8229-f3fc-4362-a430-08dc7c41418b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:40.017704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe8229-f3fc-4362-a430-08dc7c41418b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:40.019023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 735/1473] 10.222.0.27 () {54 vars in 967 bytes} [Sun Aug 28 10:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:40.023974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e19fa2-c40a-426f-aef1-36e867947a28 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:40.024265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e19fa2-c40a-426f-aef1-36e867947a28 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:40.024572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e19fa2-c40a-426f-aef1-36e867947a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:40.099334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-15e19fa2-c40a-426f-aef1-36e867947a28 None None] MFA Rules not processed for user `00283447a1a6405b952e541a13c91110`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:40.100487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-15e19fa2-c40a-426f-aef1-36e867947a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:40.120832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:40.176568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 739/1474] 10.222.0.27 () {58 vars in 1064 bytes} [Sun Aug 28 10:19:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:40.184016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8229-f3fc-4362-a430-08dc7c41418b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:40.185570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2ebe8229-f3fc-4362-a430-08dc7c41418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:40.288318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe8229-f3fc-4362-a430-08dc7c41418b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:40.360382 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48944-0b2f-4f4a-b9e4-69998c6ca714 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00283447a1a6405b952e541a13c91110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:40.360941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48944-0b2f-4f4a-b9e4-69998c6ca714 service glance] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:40.361219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48944-0b2f-4f4a-b9e4-69998c6ca714 service glance] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:40.361490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48944-0b2f-4f4a-b9e4-69998c6ca714 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:40.363075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8de48944-0b2f-4f4a-b9e4-69998c6ca714 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:40.416164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:40.470557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48944-0b2f-4f4a-b9e4-69998c6ca714 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:40.472005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48944-0b2f-4f4a-b9e4-69998c6ca714 service glance] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:40.490072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 736/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:42.492141 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5304-2f7d-45f3-84dd-de17a5444a02 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:42.492737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5304-2f7d-45f3-84dd-de17a5444a02 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:42.492737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e5304-2f7d-45f3-84dd-de17a5444a02 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:42.494242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 740/1476] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:42.500085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fb4b1-98bc-4ec9-a3b3-0be1ed681fcb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:42.500504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fb4b1-98bc-4ec9-a3b3-0be1ed681fcb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:42.500677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fb4b1-98bc-4ec9-a3b3-0be1ed681fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:42.564919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-134fb4b1-98bc-4ec9-a3b3-0be1ed681fcb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:42.566108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-134fb4b1-98bc-4ec9-a3b3-0be1ed681fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:42.659576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 737/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:42.943743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5304-2f7d-45f3-84dd-de17a5444a02 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:42.945400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0e5e5304-2f7d-45f3-84dd-de17a5444a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:43.071823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e5304-2f7d-45f3-84dd-de17a5444a02 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:43.121287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:43.166221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af440-7db4-4985-8588-212b38c746b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:43.166829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af440-7db4-4985-8588-212b38c746b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:43.167108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af440-7db4-4985-8588-212b38c746b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:43.167382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af440-7db4-4985-8588-212b38c746b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:43.168020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af440-7db4-4985-8588-212b38c746b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:43.170520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-a73af440-7db4-4985-8588-212b38c746b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:19:43.170520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 28 10:19:43.170520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: Aug 28 10:19:43.171673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af440-7db4-4985-8588-212b38c746b9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:43.191104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 741/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 28 10:19:42 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:19:45.123214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b57f-50c0-4dd8-96bf-95317bf1a02b None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:45.123797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b57f-50c0-4dd8-96bf-95317bf1a02b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:45.123797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b57f-50c0-4dd8-96bf-95317bf1a02b None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:45.125180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 738/1479] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:45.130536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f2af-9450-463a-8117-fb2ddc5894b9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:45.130929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f2af-9450-463a-8117-fb2ddc5894b9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:45.131083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f2af-9450-463a-8117-fb2ddc5894b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:45.196171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2166f2af-9450-463a-8117-fb2ddc5894b9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:45.197412 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2166f2af-9450-463a-8117-fb2ddc5894b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:45.293354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 742/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:45.594630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5b57f-50c0-4dd8-96bf-95317bf1a02b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:45.596176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-80c5b57f-50c0-4dd8-96bf-95317bf1a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:45.605941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:45.741174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5b57f-50c0-4dd8-96bf-95317bf1a02b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:45.820123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:45.853958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480ab6-b997-400d-b189-c9c14982b1c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:45.854567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480ab6-b997-400d-b189-c9c14982b1c6 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:45.854848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480ab6-b997-400d-b189-c9c14982b1c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:45.855119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480ab6-b997-400d-b189-c9c14982b1c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:45.856821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-dd480ab6-b997-400d-b189-c9c14982b1c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:45.944919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480ab6-b997-400d-b189-c9c14982b1c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:45.946503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480ab6-b997-400d-b189-c9c14982b1c6 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:45.964675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 739/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:48.053136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012688a-edf2-49a4-9335-26ed9dc87fda None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:48.053683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012688a-edf2-49a4-9335-26ed9dc87fda None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:48.053683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012688a-edf2-49a4-9335-26ed9dc87fda None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:48.055001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 743/1482] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:48.060788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872366-232e-441c-86b7-2fcb412c26da None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:48.061237 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872366-232e-441c-86b7-2fcb412c26da None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:48.061344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872366-232e-441c-86b7-2fcb412c26da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:48.132435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d6872366-232e-441c-86b7-2fcb412c26da None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:48.133655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d6872366-232e-441c-86b7-2fcb412c26da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:48.182328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:48.234997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 740/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:48.523074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012688a-edf2-49a4-9335-26ed9dc87fda None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:48.524932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0012688a-edf2-49a4-9335-26ed9dc87fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:48.548738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:48.627300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012688a-edf2-49a4-9335-26ed9dc87fda None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:48.699235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413cffc-10f4-40a9-96c3-707e2136be9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:48.700478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413cffc-10f4-40a9-96c3-707e2136be9a service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:48.700756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413cffc-10f4-40a9-96c3-707e2136be9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:48.701024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413cffc-10f4-40a9-96c3-707e2136be9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:48.702587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c413cffc-10f4-40a9-96c3-707e2136be9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:48.774607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:48.809909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413cffc-10f4-40a9-96c3-707e2136be9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:48.811339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413cffc-10f4-40a9-96c3-707e2136be9a service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:48.831339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 744/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:50.808573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7a64-fbba-4f49-aaf7-0f9f84fade5c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:50.809733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7a64-fbba-4f49-aaf7-0f9f84fade5c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:50.809733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea7a64-fbba-4f49-aaf7-0f9f84fade5c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:50.811097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 741/1485] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:50.816258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff170-599c-47b3-bd44-609e9b8a6f02 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:50.816725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff170-599c-47b3-bd44-609e9b8a6f02 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:50.816835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff170-599c-47b3-bd44-609e9b8a6f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:50.883714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e96ff170-599c-47b3-bd44-609e9b8a6f02 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:50.884943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e96ff170-599c-47b3-bd44-609e9b8a6f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:50.980484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 745/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:51.279872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7a64-fbba-4f49-aaf7-0f9f84fade5c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:51.281486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bbea7a64-fbba-4f49-aaf7-0f9f84fade5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:51.384312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea7a64-fbba-4f49-aaf7-0f9f84fade5c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:51.455688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:51.457372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2429f-72ea-4216-8af6-41fbd7950533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:51.458024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2429f-72ea-4216-8af6-41fbd7950533 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:51.458304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2429f-72ea-4216-8af6-41fbd7950533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:51.458576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2429f-72ea-4216-8af6-41fbd7950533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:51.460189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e9b2429f-72ea-4216-8af6-41fbd7950533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:51.566298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2429f-72ea-4216-8af6-41fbd7950533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:51.567653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2429f-72ea-4216-8af6-41fbd7950533 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:51.585825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 742/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:53.684625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f179f65-738b-418b-a2f4-d79fc7a7add7 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:53.685219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f179f65-738b-418b-a2f4-d79fc7a7add7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:53.685219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f179f65-738b-418b-a2f4-d79fc7a7add7 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:53.686516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 746/1488] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:53.691716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9f8cd-1cca-4967-83b5-c13d862b15f9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:53.692142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9f8cd-1cca-4967-83b5-c13d862b15f9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:53.692245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9f8cd-1cca-4967-83b5-c13d862b15f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:53.758396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2fb9f8cd-1cca-4967-83b5-c13d862b15f9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:53.759595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2fb9f8cd-1cca-4967-83b5-c13d862b15f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:53.812845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:53.857098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 743/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:54.149800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f179f65-738b-418b-a2f4-d79fc7a7add7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:54.151351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0f179f65-738b-418b-a2f4-d79fc7a7add7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:54.188580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:54.256788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f179f65-738b-418b-a2f4-d79fc7a7add7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:54.331078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17222be6-d000-4810-aa63-9f4fde7802f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:54.331688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17222be6-d000-4810-aa63-9f4fde7802f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:54.331973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17222be6-d000-4810-aa63-9f4fde7802f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:54.332282 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17222be6-d000-4810-aa63-9f4fde7802f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:54.333903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-17222be6-d000-4810-aa63-9f4fde7802f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:54.426551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:54.457860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17222be6-d000-4810-aa63-9f4fde7802f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:54.459304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17222be6-d000-4810-aa63-9f4fde7802f1 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:54.478813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 747/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:19:56.776083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f836-c6e6-4b24-89a7-026c3d403434 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:56.776746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f836-c6e6-4b24-89a7-026c3d403434 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:56.776746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f836-c6e6-4b24-89a7-026c3d403434 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:56.778658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 744/1491] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 28 10:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:19:56.784213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16625-ce78-4b66-8809-f03dbceefce8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:56.784660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16625-ce78-4b66-8809-f03dbceefce8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:56.784785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c16625-ce78-4b66-8809-f03dbceefce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:56.851869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-53c16625-ce78-4b66-8809-f03dbceefce8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:19:56.853121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-53c16625-ce78-4b66-8809-f03dbceefce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:56.948458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 748/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 28 10:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:19:57.240031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f836-c6e6-4b24-89a7-026c3d403434 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:19:57.241740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0ec5f836-c6e6-4b24-89a7-026c3d403434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:57.346321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f836-c6e6-4b24-89a7-026c3d403434 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:19:57.421153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b985cb-5bd3-44f1-bfc4-3b6a90c463d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:19:57.421748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b985cb-5bd3-44f1-bfc4-3b6a90c463d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:19:57.422019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b985cb-5bd3-44f1-bfc4-3b6a90c463d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:19:57.422284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b985cb-5bd3-44f1-bfc4-3b6a90c463d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:19:57.423866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-49b985cb-5bd3-44f1-bfc4-3b6a90c463d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:19:57.432248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:19:57.531888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b985cb-5bd3-44f1-bfc4-3b6a90c463d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:19:57.533280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b985cb-5bd3-44f1-bfc4-3b6a90c463d1 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:19:57.551945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 745/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:20:06.946594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:20:07.549703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=50 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:43.069125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40193456-e3fd-4468-82e1-0f9124a44413 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:43.069684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40193456-e3fd-4468-82e1-0f9124a44413 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:43.069684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40193456-e3fd-4468-82e1-0f9124a44413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:43.145190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-40193456-e3fd-4468-82e1-0f9124a44413 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:21:43.146669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-40193456-e3fd-4468-82e1-0f9124a44413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:43.240089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 749/1494] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:21:43.248965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c27eb-6c0e-4524-8c16-5a9f3936188c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:43.249478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c27eb-6c0e-4524-8c16-5a9f3936188c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:43.249598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c27eb-6c0e-4524-8c16-5a9f3936188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:43.323805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1e6c27eb-6c0e-4524-8c16-5a9f3936188c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:21:43.324954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e6c27eb-6c0e-4524-8c16-5a9f3936188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:43.419831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 746/1495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:21:43.424485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40193456-e3fd-4468-82e1-0f9124a44413 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:43.425701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-40193456-e3fd-4468-82e1-0f9124a44413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:43.437775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40193456-e3fd-4468-82e1-0f9124a44413 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:43.498262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:43.531551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:43.532159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:43.532479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:43.532763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:43.533418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:21:43.533722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:43.534728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:21:43.534728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 28 10:21:43.534728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: Aug 28 10:21:43.535678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:43.547802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 750/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:21:43.556177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c27eb-6c0e-4524-8c16-5a9f3936188c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:43.565384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c27eb-6c0e-4524-8c16-5a9f3936188c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:43.626583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:43.659999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:43.660635 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:43.660917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:43.661192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:43.661862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:43.663577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:21:43.663577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 28 10:21:43.663577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: Aug 28 10:21:43.664808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:43.810897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 747/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:21:43 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:21:43.815131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:43.816684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:43.850472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cbde8-347c-4bfa-aad7-04c2f575a899 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:43.944743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:43.945267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:43.945546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:43.945818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:43.947072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:43.948074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:21:43.948074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 28 10:21:43.948074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: Aug 28 10:21:43.949303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:44.083220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 751/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:21:43 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:21:44.087830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:44.089616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:44.151707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221895-58e9-415d-b90c-0f752aa41cc1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:44.233406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:44.243106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:44.243736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:44.244009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:44.244273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:44.244940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:44.245952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:21:44.245952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 28 10:21:44.245952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: Aug 28 10:21:44.246842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:44.258787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 748/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:21:44.263995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:44.265616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:44.277846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3408d-44d1-4a45-bec0-21c3fd29a37d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:44.305043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:44.374882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9b393-1626-47f9-8569-56a044093c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:44.375484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b393-1626-47f9-8569-56a044093c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:44.375762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b393-1626-47f9-8569-56a044093c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:44.376029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9b393-1626-47f9-8569-56a044093c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:44.376701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b393-1626-47f9-8569-56a044093c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:44.377755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-d3b9b393-1626-47f9-8569-56a044093c70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:21:44.377755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 28 10:21:44.377755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: Aug 28 10:21:44.378640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9b393-1626-47f9-8569-56a044093c70 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:44.392972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 752/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:21:44.396881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:44.398392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:44.431977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe338965-987b-4118-8c91-9b50e4ec3c97 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:44.524584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd595-0b69-4954-a18b-ecfb9f77ec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:44.525194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd595-0b69-4954-a18b-ecfb9f77ec5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:44.525473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd595-0b69-4954-a18b-ecfb9f77ec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:44.525749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd595-0b69-4954-a18b-ecfb9f77ec5e admin admin] PATH_INFO: `/v3/projects/f3e1f3882af94324b02a87ad2a49a4e9/users/5ba8de90c52d4dca85bea4c8671dd259/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:44.548885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd595-0b69-4954-a18b-ecfb9f77ec5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e1f3882af94324b02a87ad2a49a4e9, user_id=5ba8de90c52d4dca85bea4c8671dd259, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:44.549927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-226cd595-0b69-4954-a18b-ecfb9f77ec5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:21:44.549927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 28 10:21:44.549927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: Aug 28 10:21:44.551888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd595-0b69-4954-a18b-ecfb9f77ec5e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:44.641856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 749/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:21:44 2022] PUT /identity/v3/projects/f3e1f3882af94324b02a87ad2a49a4e9/users/5ba8de90c52d4dca85bea4c8671dd259/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:21:44.654426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bf50-351b-48cb-87d9-bc3c4b15c14a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:44.654710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bf50-351b-48cb-87d9-bc3c4b15c14a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:44.654996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7bf50-351b-48cb-87d9-bc3c4b15c14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:44.711217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-30f7bf50-351b-48cb-87d9-bc3c4b15c14a None None] MFA Rules not processed for user `5ba8de90c52d4dca85bea4c8671dd259`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:21:44.712577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-30f7bf50-351b-48cb-87d9-bc3c4b15c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:44.787226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 753/1502] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:21:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:21:44.800905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabb2de-e595-4ac7-aa68-db307f38fcf7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:44.801225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabb2de-e595-4ac7-aa68-db307f38fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:44.801512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabb2de-e595-4ac7-aa68-db307f38fcf7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:44.802853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 750/1503] 10.222.0.27 () {54 vars in 964 bytes} [Sun Aug 28 10:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:21:44.808440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ae16-e10f-4978-ab06-30740fd32e68 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:44.808736 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ae16-e10f-4978-ab06-30740fd32e68 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:44.809016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ae16-e10f-4978-ab06-30740fd32e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:44.840401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:44.886018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5ae6ae16-e10f-4978-ab06-30740fd32e68 None None] MFA Rules not processed for user `4b03cdf17a244cf094a7ce93775da22c`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:21:44.887240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5ae6ae16-e10f-4978-ab06-30740fd32e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:44.963544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 754/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Aug 28 10:21:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:21:44.971272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabb2de-e595-4ac7-aa68-db307f38fcf7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:44.972877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6dabb2de-e595-4ac7-aa68-db307f38fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:45.023132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:45.077744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabb2de-e595-4ac7-aa68-db307f38fcf7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:45.154250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:45.154858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:45.155140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:45.155414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:45.157068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:45.253423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:45.254854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:45.258287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:45.273283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 751/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:21:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:21:45.318675 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cf39f-6fc3-4d5a-8060-1c223703ad07 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:45.319114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cf39f-6fc3-4d5a-8060-1c223703ad07 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:45.319229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cf39f-6fc3-4d5a-8060-1c223703ad07 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:45.320582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 755/1506] 10.222.0.27 () {52 vars in 830 bytes} [Sun Aug 28 10:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:21:45.324179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:45.325446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:45.423304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafe6dc-21e9-4ac9-872a-feea15cdd46c service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:45.514938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:45.515556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:45.515828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:45.516094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] PATH_INFO: `/v3/users/5ba8de90c52d4dca85bea4c8671dd259` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:45.528822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba8de90c52d4dca85bea4c8671dd259)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:45.529850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:21:45.529850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 28 10:21:45.529850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: Aug 28 10:21:45.531062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:45.540714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:45.730516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba8de90c52d4dca85bea4c8671dd259'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:45.745568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba8de90c52d4dca85bea4c8671dd259'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:45.858672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba8de90c52d4dca85bea4c8671dd259'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:45.883014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba8de90c52d4dca85bea4c8671dd259'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:45.883576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba8de90c52d4dca85bea4c8671dd259'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:45.890174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 752/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:21:45 2022] DELETE /identity/v3/users/5ba8de90c52d4dca85bea4c8671dd259 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:21:45.894766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276b53-0edb-4b85-a4ce-36797f3d5f8d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:45.895055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276b53-0edb-4b85-a4ce-36797f3d5f8d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:45.895352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276b53-0edb-4b85-a4ce-36797f3d5f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:45.953217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1d276b53-0edb-4b85-a4ce-36797f3d5f8d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:21:45.954403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d276b53-0edb-4b85-a4ce-36797f3d5f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:46.029136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:46.041775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 756/1508] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:21:46.051429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:46.052748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:46.160864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e0e0-d29f-4d9a-874d-25a9be94a74c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:46.219772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:46.242402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3258d7b-4d17-4b03-964e-db9cd5aba5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:46.245049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3258d7b-4d17-4b03-964e-db9cd5aba5db service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:46.245049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3258d7b-4d17-4b03-964e-db9cd5aba5db service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:46.245049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3258d7b-4d17-4b03-964e-db9cd5aba5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:46.246696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e3258d7b-4d17-4b03-964e-db9cd5aba5db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:46.360305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3258d7b-4d17-4b03-964e-db9cd5aba5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:46.361781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3258d7b-4d17-4b03-964e-db9cd5aba5db service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:46.381175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 753/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:21:46.867120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d276b53-0edb-4b85-a4ce-36797f3d5f8d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:21:46.869043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d276b53-0edb-4b85-a4ce-36797f3d5f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:21:46.880544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d276b53-0edb-4b85-a4ce-36797f3d5f8d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:21:46.897868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:21:46.898506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:21:46.898899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:21:46.899315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] PATH_INFO: `/v3/projects/f3e1f3882af94324b02a87ad2a49a4e9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:21:46.918064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e1f3882af94324b02a87ad2a49a4e9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:21:46.919102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:21:46.919102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 28 10:21:46.919102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: Aug 28 10:21:46.920348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:21:47.053165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e1f3882af94324b02a87ad2a49a4e9', 'request_id': 'req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:47.066703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e1f3882af94324b02a87ad2a49a4e9', 'request_id': 'req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:47.073424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e1f3882af94324b02a87ad2a49a4e9', 'request_id': 'req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:47.145738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] The token cache is being invalidate because project f3e1f3882af94324b02a87ad2a49a4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:21:47.145968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:47.146720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2a3c7809-22ff-45d1-aa31-0ebd839e2a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:21:47.148225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 757/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:21:46 2022] DELETE /identity/v3/projects/f3e1f3882af94324b02a87ad2a49a4e9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:21:56.378653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=62 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:21:57.141625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:23:18.830109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe12b9-6eb0-4f0c-be8c-0c4069d2123a None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:18.830703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe12b9-6eb0-4f0c-be8c-0c4069d2123a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:18.830703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe12b9-6eb0-4f0c-be8c-0c4069d2123a None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:18.832002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:23:18.837359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac806f-f25e-43d5-9f45-3966e00da62f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:18.837764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac806f-f25e-43d5-9f45-3966e00da62f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:18.837914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac806f-f25e-43d5-9f45-3966e00da62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:18.893477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9aac806f-f25e-43d5-9f45-3966e00da62f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:18.894675 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9aac806f-f25e-43d5-9f45-3966e00da62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:18.951671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:19.112687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe12b9-6eb0-4f0c-be8c-0c4069d2123a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:19.112687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-09fe12b9-6eb0-4f0c-be8c-0c4069d2123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:19.213310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe12b9-6eb0-4f0c-be8c-0c4069d2123a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:19.218666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18598e45-a70e-440d-ac9e-f7672ebf553f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:19.219264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18598e45-a70e-440d-ac9e-f7672ebf553f service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:19.219541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18598e45-a70e-440d-ac9e-f7672ebf553f service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:19.219808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18598e45-a70e-440d-ac9e-f7672ebf553f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:19.228123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18598e45-a70e-440d-ac9e-f7672ebf553f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:19.229769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18598e45-a70e-440d-ac9e-f7672ebf553f service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:19.239117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 755/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:23:20.072218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c963-8ad8-47dc-8248-6e478ce7abeb None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:20.072800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c963-8ad8-47dc-8248-6e478ce7abeb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:20.072800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c963-8ad8-47dc-8248-6e478ce7abeb None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:20.074156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:23:20.078982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dffd68-10e0-4503-b4f4-a292cd348c01 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:20.079456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dffd68-10e0-4503-b4f4-a292cd348c01 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:20.079581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dffd68-10e0-4503-b4f4-a292cd348c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:20.098828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e8dffd68-10e0-4503-b4f4-a292cd348c01 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:20.099954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e8dffd68-10e0-4503-b4f4-a292cd348c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:20.108280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:20.260753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405c963-8ad8-47dc-8248-6e478ce7abeb None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:20.276348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405c963-8ad8-47dc-8248-6e478ce7abeb None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:20.281812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6836d6-e272-4328-a4e6-6a773c2b4b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:20.282408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6836d6-e272-4328-a4e6-6a773c2b4b24 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:20.282693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6836d6-e272-4328-a4e6-6a773c2b4b24 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:20.282971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6836d6-e272-4328-a4e6-6a773c2b4b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:20.291540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6836d6-e272-4328-a4e6-6a773c2b4b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:20.293169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6836d6-e272-4328-a4e6-6a773c2b4b24 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:20.302395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 760/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:23:20.835979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b25ac-eda2-4b0e-b42c-91f491f76e9e None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:20.835979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b25ac-eda2-4b0e-b42c-91f491f76e9e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:20.836266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b25ac-eda2-4b0e-b42c-91f491f76e9e None None] PATH_INFO: `/v3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:20.837517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 757/1517] 10.222.0.20 () {54 vars in 925 bytes} [Sun Aug 28 10:23:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:23:20.843608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d55b-4de5-4cee-a1f8-e02d7a09de6f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:20.843896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d55b-4de5-4cee-a1f8-e02d7a09de6f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:20.844172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67d55b-4de5-4cee-a1f8-e02d7a09de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:20.904817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2e67d55b-4de5-4cee-a1f8-e02d7a09de6f None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:20.906022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2e67d55b-4de5-4cee-a1f8-e02d7a09de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:20.978560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 761/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Aug 28 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:25.001935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8a77-abfd-4353-879c-146c8795b64c None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:25.002463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8a77-abfd-4353-879c-146c8795b64c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:25.002463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8a77-abfd-4353-879c-146c8795b64c None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:25.003738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 758/1519] 10.222.0.27 () {54 vars in 961 bytes} [Sun Aug 28 10:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:23:25.009700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529afdc-0ec4-47bc-bd40-50709264edda None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:25.010151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529afdc-0ec4-47bc-bd40-50709264edda None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:25.010271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529afdc-0ec4-47bc-bd40-50709264edda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:25.029460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1529afdc-0ec4-47bc-bd40-50709264edda None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:25.030646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1529afdc-0ec4-47bc-bd40-50709264edda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:25.038975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 762/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 28 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:25.046307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee8a77-abfd-4353-879c-146c8795b64c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:25.060054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee8a77-abfd-4353-879c-146c8795b64c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:25.065035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb509746-cc94-4182-8da0-aa869fa5b7a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:25.065616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb509746-cc94-4182-8da0-aa869fa5b7a6 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:25.065889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb509746-cc94-4182-8da0-aa869fa5b7a6 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:25.066158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb509746-cc94-4182-8da0-aa869fa5b7a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:25.075087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb509746-cc94-4182-8da0-aa869fa5b7a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:25.076692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb509746-cc94-4182-8da0-aa869fa5b7a6 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:25.086409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 759/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:23:31.555582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273804-4d7b-46fb-b85b-fc867f17a949 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:31.556146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273804-4d7b-46fb-b85b-fc867f17a949 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:31.556146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273804-4d7b-46fb-b85b-fc867f17a949 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:31.557562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:23:31.562524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668932-c111-4c16-8278-7db734555175 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:31.563008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668932-c111-4c16-8278-7db734555175 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:31.563136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59668932-c111-4c16-8278-7db734555175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:31.582173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-59668932-c111-4c16-8278-7db734555175 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:31.583364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-59668932-c111-4c16-8278-7db734555175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:31.591692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:31.746233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96273804-4d7b-46fb-b85b-fc867f17a949 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:31.755725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:23:31.760876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96273804-4d7b-46fb-b85b-fc867f17a949 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:31.766355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47147c1-8a0e-4b5e-8ff2-1142bbadb998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:31.766949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47147c1-8a0e-4b5e-8ff2-1142bbadb998 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:31.767233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47147c1-8a0e-4b5e-8ff2-1142bbadb998 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:31.767510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47147c1-8a0e-4b5e-8ff2-1142bbadb998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:31.776389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47147c1-8a0e-4b5e-8ff2-1142bbadb998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:31.777974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47147c1-8a0e-4b5e-8ff2-1142bbadb998 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:31.787127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 764/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:23:32.605779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdcc80-5a0a-4743-a67a-540b0f9730b6 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:32.606346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdcc80-5a0a-4743-a67a-540b0f9730b6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:32.606346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdcc80-5a0a-4743-a67a-540b0f9730b6 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:32.607674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 10:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:23:32.612565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d02a-cb8d-4ca3-95e9-f56c992d9aff None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:32.612988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d02a-cb8d-4ca3-95e9-f56c992d9aff None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:32.613143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d02a-cb8d-4ca3-95e9-f56c992d9aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:32.632806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4a98d02a-cb8d-4ca3-95e9-f56c992d9aff None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:32.633990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4a98d02a-cb8d-4ca3-95e9-f56c992d9aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:32.641701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 10:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:32.793775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdcc80-5a0a-4743-a67a-540b0f9730b6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:32.807986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdcc80-5a0a-4743-a67a-540b0f9730b6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:32.813357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b312ba-068e-4dea-b4d0-5e2837c76d12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:32.813947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b312ba-068e-4dea-b4d0-5e2837c76d12 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:32.814229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b312ba-068e-4dea-b4d0-5e2837c76d12 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:32.814502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b312ba-068e-4dea-b4d0-5e2837c76d12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:32.822994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b312ba-068e-4dea-b4d0-5e2837c76d12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:32.824626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b312ba-068e-4dea-b4d0-5e2837c76d12 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:32.835439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 762/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:23:36.858330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5122-b3f4-43e3-b096-7dee93a524e1 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:36.858837 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5122-b3f4-43e3-b096-7dee93a524e1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:36.858972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5122-b3f4-43e3-b096-7dee93a524e1 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:36.860237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:23:36.865409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3a7e8-8868-46bb-8794-f93af2874da5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:36.866351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3a7e8-8868-46bb-8794-f93af2874da5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:36.866607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3a7e8-8868-46bb-8794-f93af2874da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:36.886933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-89d3a7e8-8868-46bb-8794-f93af2874da5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:36.888132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-89d3a7e8-8868-46bb-8794-f93af2874da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:36.896090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:23:37.185254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b5122-b3f4-43e3-b096-7dee93a524e1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:37.186931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-714b5122-b3f4-43e3-b096-7dee93a524e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:37.254829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b5122-b3f4-43e3-b096-7dee93a524e1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:37.258908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0f300-c44f-435b-9c24-373aa30317f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:37.259506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0f300-c44f-435b-9c24-373aa30317f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:37.259786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0f300-c44f-435b-9c24-373aa30317f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:37.260060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0f300-c44f-435b-9c24-373aa30317f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:37.269035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0f300-c44f-435b-9c24-373aa30317f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:37.270455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0f300-c44f-435b-9c24-373aa30317f2 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:37.280278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 767/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:23:39.181861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b39a4-1cfe-49bd-aa2b-34db999bce7f None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:39.182462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b39a4-1cfe-49bd-aa2b-34db999bce7f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:39.182462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b39a4-1cfe-49bd-aa2b-34db999bce7f None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:39.183779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:23:39.189202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8899b2-9596-4701-8f2b-b901be8f0b44 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:39.189651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8899b2-9596-4701-8f2b-b901be8f0b44 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:39.189796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8899b2-9596-4701-8f2b-b901be8f0b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:39.209846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ee8899b2-9596-4701-8f2b-b901be8f0b44 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:39.211041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ee8899b2-9596-4701-8f2b-b901be8f0b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:39.218890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:39.511496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b39a4-1cfe-49bd-aa2b-34db999bce7f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:39.513229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a20b39a4-1cfe-49bd-aa2b-34db999bce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:39.526431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b39a4-1cfe-49bd-aa2b-34db999bce7f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:39.530031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19adfe-6059-4583-bb5a-0e68a910a002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:39.530626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19adfe-6059-4583-bb5a-0e68a910a002 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:39.530901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19adfe-6059-4583-bb5a-0e68a910a002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:39.531170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19adfe-6059-4583-bb5a-0e68a910a002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:39.540565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19adfe-6059-4583-bb5a-0e68a910a002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:39.541992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19adfe-6059-4583-bb5a-0e68a910a002 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:39.551196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 765/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:23:43.033948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cdd09-ba64-42e8-a8ed-5a297a3ca900 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:43.034478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cdd09-ba64-42e8-a8ed-5a297a3ca900 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:43.034478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cdd09-ba64-42e8-a8ed-5a297a3ca900 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:43.035798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:23:43.042064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ad81-0e44-4c0c-ba94-88692fea3e82 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:43.042484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ad81-0e44-4c0c-ba94-88692fea3e82 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:43.042616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ad81-0e44-4c0c-ba94-88692fea3e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:43.061729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a1a9ad81-0e44-4c0c-ba94-88692fea3e82 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:43.062929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a1a9ad81-0e44-4c0c-ba94-88692fea3e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:43.071027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:43.631871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cdd09-ba64-42e8-a8ed-5a297a3ca900 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:43.633771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f07cdd09-ba64-42e8-a8ed-5a297a3ca900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:43.713277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07cdd09-ba64-42e8-a8ed-5a297a3ca900 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:43.716814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72b57d-a634-4989-b08c-d0b4acac2412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:43.717489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b57d-a634-4989-b08c-d0b4acac2412 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:43.717764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b57d-a634-4989-b08c-d0b4acac2412 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:43.718034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b57d-a634-4989-b08c-d0b4acac2412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:43.726993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b57d-a634-4989-b08c-d0b4acac2412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:43.728447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b57d-a634-4989-b08c-d0b4acac2412 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:43.737858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 770/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:23:45.666395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508698c1-6619-433a-b595-5bc903ae4eb7 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:45.666940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508698c1-6619-433a-b595-5bc903ae4eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:45.666940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508698c1-6619-433a-b595-5bc903ae4eb7 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:45.668354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 10:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:23:45.673548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744fb1-7ca7-4854-bf90-340177ddc333 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:45.673997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744fb1-7ca7-4854-bf90-340177ddc333 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:45.674107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744fb1-7ca7-4854-bf90-340177ddc333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:45.693042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1d744fb1-7ca7-4854-bf90-340177ddc333 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:23:45.695003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d744fb1-7ca7-4854-bf90-340177ddc333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:45.702635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:23:46.261136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508698c1-6619-433a-b595-5bc903ae4eb7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:23:46.262854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-508698c1-6619-433a-b595-5bc903ae4eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:23:46.276248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508698c1-6619-433a-b595-5bc903ae4eb7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:23:46.279835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12f382-fa4b-4654-af00-104e19658e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:23:46.280486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12f382-fa4b-4654-af00-104e19658e9d service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:23:46.280763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12f382-fa4b-4654-af00-104e19658e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:23:46.281028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12f382-fa4b-4654-af00-104e19658e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:23:46.290746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12f382-fa4b-4654-af00-104e19658e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:23:46.292164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12f382-fa4b-4654-af00-104e19658e9d service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:23:46.301307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 768/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:23:55.688491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=79 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:23:56.297271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=82 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:13.726530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26533-29f2-4cc7-8472-0fc81c4d8d62 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:13.749047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26533-29f2-4cc7-8472-0fc81c4d8d62 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:13.749047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26533-29f2-4cc7-8472-0fc81c4d8d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:13.750630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20e19-0a5d-44fb-a5c4-9cca40598b80 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:13.751140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20e19-0a5d-44fb-a5c4-9cca40598b80 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:13.751250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20e19-0a5d-44fb-a5c4-9cca40598b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:13.754263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-23a26533-29f2-4cc7-8472-0fc81c4d8d62 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:13.755489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-23a26533-29f2-4cc7-8472-0fc81c4d8d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:13.769023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 772/1540] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:13.777808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb04bb-93f0-4732-803b-5ddf7da844b0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:13.778293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb04bb-93f0-4732-803b-5ddf7da844b0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:13.778517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb04bb-93f0-4732-803b-5ddf7da844b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:13.782664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1bb20e19-0a5d-44fb-a5c4-9cca40598b80 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:13.784011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1bb20e19-0a5d-44fb-a5c4-9cca40598b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:13.799749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 769/1541] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:13.813655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f1eb04bb-93f0-4732-803b-5ddf7da844b0 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:13.814727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5ce8-5d38-43b9-b5b7-e67d03314691 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:13.814873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f1eb04bb-93f0-4732-803b-5ddf7da844b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:13.815064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5ce8-5d38-43b9-b5b7-e67d03314691 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:13.815284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5ce8-5d38-43b9-b5b7-e67d03314691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:13.832781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 773/1542] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:13.845561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb04bb-93f0-4732-803b-5ddf7da844b0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:13.850152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9a6b5ce8-5d38-43b9-b5b7-e67d03314691 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:13.851397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9a6b5ce8-5d38-43b9-b5b7-e67d03314691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:13.858469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb04bb-93f0-4732-803b-5ddf7da844b0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:13.864749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 770/1543] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:13.870533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5ce8-5d38-43b9-b5b7-e67d03314691 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:13.881733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5ce8-5d38-43b9-b5b7-e67d03314691 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:13.885954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:13.886619 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:13.886888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:13.887163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:13.887838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:13.888146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:13.889799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:13.893296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:13.893926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:13.894319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:13.894499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:13.897019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:13.897019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:13.897019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:25:13.897019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 28 10:25:13.897019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: Aug 28 10:25:13.897778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:13.915383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 774/1544] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:13.921414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:13.923567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 771/1545] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:25:13.933382 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:13.941977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b92d1-255a-434e-8850-f2f15d0925f0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:13.952127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30415ebe-4878-400d-9322-4f3941f5dafb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:13.957134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3d14a-6414-44f8-8d2b-c32a427e02fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:13.957767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d14a-6414-44f8-8d2b-c32a427e02fb admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:13.958025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:13.958160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d14a-6414-44f8-8d2b-c32a427e02fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:13.958343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3d14a-6414-44f8-8d2b-c32a427e02fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:13.958653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:13.959522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:13.959685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3d14a-6414-44f8-8d2b-c32a427e02fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:13.959860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:13.962248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3d14a-6414-44f8-8d2b-c32a427e02fb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:13.964496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:13.965578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:25:13.965578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 28 10:25:13.965578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: Aug 28 10:25:13.966806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.102186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 772/1546] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:13 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:25:14.103891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ff25-3790-4905-9a50-45cfa1901ad5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.104183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ff25-3790-4905-9a50-45cfa1901ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.104516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391ff25-3790-4905-9a50-45cfa1901ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.136153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 775/1547] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:13 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:14.138707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.139464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d391ff25-3790-4905-9a50-45cfa1901ad5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.139576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d391ff25-3790-4905-9a50-45cfa1901ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.252523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 773/1548] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.253578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615d64-5c86-4892-8b24-5557e7c2a23f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.253869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615d64-5c86-4892-8b24-5557e7c2a23f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.254147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93615d64-5c86-4892-8b24-5557e7c2a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.260453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18580-b0ec-4916-a7b5-efc7c71bebe9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.277445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3656-9f46-4bd7-a7e7-352ba17e237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.278259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3656-9f46-4bd7-a7e7-352ba17e237a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.278676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3656-9f46-4bd7-a7e7-352ba17e237a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.278961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3656-9f46-4bd7-a7e7-352ba17e237a admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.279613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f3656-9f46-4bd7-a7e7-352ba17e237a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.281899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f3656-9f46-4bd7-a7e7-352ba17e237a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.282486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-93615d64-5c86-4892-8b24-5557e7c2a23f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.283764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-93615d64-5c86-4892-8b24-5557e7c2a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.294858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 774/1549] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.295916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93615d64-5c86-4892-8b24-5557e7c2a23f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.319852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93615d64-5c86-4892-8b24-5557e7c2a23f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.325110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4a91-37d7-4fab-985f-6a0285ec8306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.325844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4a91-37d7-4fab-985f-6a0285ec8306 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.326238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4a91-37d7-4fab-985f-6a0285ec8306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.326614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4a91-37d7-4fab-985f-6a0285ec8306 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.327357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a4a91-37d7-4fab-985f-6a0285ec8306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.329069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-db6a4a91-37d7-4fab-985f-6a0285ec8306 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:25:14.329069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 28 10:25:14.329069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: Aug 28 10:25:14.330480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a4a91-37d7-4fab-985f-6a0285ec8306 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.370008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 776/1550] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:14.370997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c1902-ca77-4dda-b0e2-bbed460cc326 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.371287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c1902-ca77-4dda-b0e2-bbed460cc326 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.371561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c1902-ca77-4dda-b0e2-bbed460cc326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.394929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3d9c1902-ca77-4dda-b0e2-bbed460cc326 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.396135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3d9c1902-ca77-4dda-b0e2-bbed460cc326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.404964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 777/1551] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.406142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843109c-f677-42f9-b8f9-b9a7670e8627 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.406452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843109c-f677-42f9-b8f9-b9a7670e8627 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.406775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843109c-f677-42f9-b8f9-b9a7670e8627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.426080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0843109c-f677-42f9-b8f9-b9a7670e8627 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.427287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0843109c-f677-42f9-b8f9-b9a7670e8627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.435500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 778/1552] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.436838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509fc4c-a601-4886-8c26-86a0faba6f80 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.441750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509fc4c-a601-4886-8c26-86a0faba6f80 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.441906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 775/1553] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:14.442028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509fc4c-a601-4886-8c26-86a0faba6f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.442148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6623-0f77-476c-80cd-63eb47704024 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.442148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6623-0f77-476c-80cd-63eb47704024 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.442148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6623-0f77-476c-80cd-63eb47704024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.457056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1509fc4c-a601-4886-8c26-86a0faba6f80 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.458132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f33e6623-0f77-476c-80cd-63eb47704024 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.458255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1509fc4c-a601-4886-8c26-86a0faba6f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.459863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f33e6623-0f77-476c-80cd-63eb47704024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.467840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 779/1554] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.467840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce22e6-f39d-4beb-9e0f-7a6dd4fe75fe None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.481882 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 776/1555] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.482001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce22e6-f39d-4beb-9e0f-7a6dd4fe75fe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.482001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce22e6-f39d-4beb-9e0f-7a6dd4fe75fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.482196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4918b4e-c12d-4ffe-89fd-8e60173221dc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.482196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4918b4e-c12d-4ffe-89fd-8e60173221dc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.482196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4918b4e-c12d-4ffe-89fd-8e60173221dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.488722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-68ce22e6-f39d-4beb-9e0f-7a6dd4fe75fe None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.489837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e4918b4e-c12d-4ffe-89fd-8e60173221dc None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.489944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-68ce22e6-f39d-4beb-9e0f-7a6dd4fe75fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.491589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e4918b4e-c12d-4ffe-89fd-8e60173221dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.498671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 780/1556] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.499343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 777/1557] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.500547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785610f2-e1a0-46f3-8be3-42ec84923876 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.500828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785610f2-e1a0-46f3-8be3-42ec84923876 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.501099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785610f2-e1a0-46f3-8be3-42ec84923876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.505433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce22e6-f39d-4beb-9e0f-7a6dd4fe75fe None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.516932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce22e6-f39d-4beb-9e0f-7a6dd4fe75fe None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.521920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5cb33-34df-40e4-8219-fc5eac76ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.522333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-785610f2-e1a0-46f3-8be3-42ec84923876 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.522621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5cb33-34df-40e4-8219-fc5eac76ab0a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.522821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5cb33-34df-40e4-8219-fc5eac76ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.523091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5cb33-34df-40e4-8219-fc5eac76ab0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.523367 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-785610f2-e1a0-46f3-8be3-42ec84923876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.523752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5cb33-34df-40e4-8219-fc5eac76ab0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.525393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5cb33-34df-40e4-8219-fc5eac76ab0a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.531562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 778/1558] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.532380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785610f2-e1a0-46f3-8be3-42ec84923876 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.541983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 781/1559] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:14.541983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5cb33-34df-40e4-8219-fc5eac76ab0a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.542318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785610f2-e1a0-46f3-8be3-42ec84923876 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.546880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f249-554d-4747-9796-864487986121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.547475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f249-554d-4747-9796-864487986121 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.547758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f249-554d-4747-9796-864487986121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.548027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230f249-554d-4747-9796-864487986121 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.548707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f249-554d-4747-9796-864487986121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:14.549011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f249-554d-4747-9796-864487986121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.549704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5cb33-34df-40e4-8219-fc5eac76ab0a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.550677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230f249-554d-4747-9796-864487986121 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.554821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a3e54-a63e-451e-8e20-bd376304d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.555403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3e54-a63e-451e-8e20-bd376304d2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.555686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3e54-a63e-451e-8e20-bd376304d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.555961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a3e54-a63e-451e-8e20-bd376304d2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.556638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a3e54-a63e-451e-8e20-bd376304d2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.558201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a3e54-a63e-451e-8e20-bd376304d2ae admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.562942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 779/1560] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:14.563799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f249-554d-4747-9796-864487986121 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.572999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 782/1561] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:14.574142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39695-9858-4618-bd1f-d1098c7ce555 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.574430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39695-9858-4618-bd1f-d1098c7ce555 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.574709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d39695-9858-4618-bd1f-d1098c7ce555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.575548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230f249-554d-4747-9796-864487986121 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.580166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da823f7-cd6c-4e5f-863f-3b1a79dc907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.580781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da823f7-cd6c-4e5f-863f-3b1a79dc907b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.581059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da823f7-cd6c-4e5f-863f-3b1a79dc907b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.581331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da823f7-cd6c-4e5f-863f-3b1a79dc907b admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.581979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da823f7-cd6c-4e5f-863f-3b1a79dc907b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:14.582276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da823f7-cd6c-4e5f-863f-3b1a79dc907b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.584536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da823f7-cd6c-4e5f-863f-3b1a79dc907b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.594077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-16d39695-9858-4618-bd1f-d1098c7ce555 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.595296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-16d39695-9858-4618-bd1f-d1098c7ce555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.596258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 780/1562] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:14.597463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c86c71-e56e-43f1-ae10-40b1fd65e887 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.597745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c86c71-e56e-43f1-ae10-40b1fd65e887 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.598020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c86c71-e56e-43f1-ae10-40b1fd65e887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.603555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 783/1563] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.608226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d536a-98da-4280-8d13-43c0292d7b7d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.608544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d536a-98da-4280-8d13-43c0292d7b7d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.608817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d536a-98da-4280-8d13-43c0292d7b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.618265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c3c86c71-e56e-43f1-ae10-40b1fd65e887 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.619472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c3c86c71-e56e-43f1-ae10-40b1fd65e887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.627562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 781/1564] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.627722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6a7d536a-98da-4280-8d13-43c0292d7b7d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:14.628333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c86c71-e56e-43f1-ae10-40b1fd65e887 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.628885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a7d536a-98da-4280-8d13-43c0292d7b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:14.637341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 784/1565] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:14.638121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d536a-98da-4280-8d13-43c0292d7b7d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.643728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c86c71-e56e-43f1-ae10-40b1fd65e887 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.648099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d536a-98da-4280-8d13-43c0292d7b7d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.649575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.650181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.650459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.650727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.651374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:14.651673 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.652729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f641a-8287-41d4-ae45-84cbaedc076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.653308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f641a-8287-41d4-ae45-84cbaedc076c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.653423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.653590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f641a-8287-41d4-ae45-84cbaedc076c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.653866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f641a-8287-41d4-ae45-84cbaedc076c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.654512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f641a-8287-41d4-ae45-84cbaedc076c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.656122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f641a-8287-41d4-ae45-84cbaedc076c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.665906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 782/1566] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:14.666508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 785/1567] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:14.667131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f641a-8287-41d4-ae45-84cbaedc076c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.670054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.677018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f641a-8287-41d4-ae45-84cbaedc076c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.679379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdfef6-f829-494b-a2ad-72088f71ba0b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.681728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab783-9ddc-4efc-b830-1d542af2ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.682379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab783-9ddc-4efc-b830-1d542af2ed1d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.682605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab783-9ddc-4efc-b830-1d542af2ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.682880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ab783-9ddc-4efc-b830-1d542af2ed1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.683572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ab783-9ddc-4efc-b830-1d542af2ed1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.683848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35032f-795f-4e33-bbe2-445322cc05a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.684467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35032f-795f-4e33-bbe2-445322cc05a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.684747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35032f-795f-4e33-bbe2-445322cc05a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.685018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35032f-795f-4e33-bbe2-445322cc05a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.685211 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ab783-9ddc-4efc-b830-1d542af2ed1d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.685650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35032f-795f-4e33-bbe2-445322cc05a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.687545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35032f-795f-4e33-bbe2-445322cc05a0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.695648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 786/1568] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:14.696453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab783-9ddc-4efc-b830-1d542af2ed1d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.700713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:14.706016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ab783-9ddc-4efc-b830-1d542af2ed1d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.711306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92530-053e-45e7-9bff-0d82fa3211c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.711887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92530-053e-45e7-9bff-0d82fa3211c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.712237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92530-053e-45e7-9bff-0d82fa3211c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.712544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92530-053e-45e7-9bff-0d82fa3211c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.713169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92530-053e-45e7-9bff-0d82fa3211c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.716393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92530-053e-45e7-9bff-0d82fa3211c9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.720383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:14.797529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 783/1569] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:14.798930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35032f-795f-4e33-bbe2-445322cc05a0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.810375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 787/1570] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:14.811774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92530-053e-45e7-9bff-0d82fa3211c9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.862480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35032f-795f-4e33-bbe2-445322cc05a0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.878114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92530-053e-45e7-9bff-0d82fa3211c9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.883483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.884106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.884442 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.884726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.885385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:14.885694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.887331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.900516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 788/1571] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:14.901348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.911079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86223e60-6215-415c-9b25-0d307d37c5da admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.915915 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.916588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.917524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.917524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.917906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:14.918218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.919875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.925779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.927742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.927742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.927742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.927742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:14.928703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.930311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.932986 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 789/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:14.933774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.945827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414f89-0b20-42df-83f7-ae780311ea90 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.947599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 784/1573] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:14.947599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:14.951898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.952587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.952871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.953146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] PATH_INFO: `/v3/projects/5944bc980b374729bb36a1becfe2554d/users/ba828c11574b4a7cbea949fc21a1b8d7/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.961667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780633c-fe44-487e-bf69-b4f7bd7933d3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:14.966490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066624-f9ca-4c12-a3cd-bc94824d1cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:14.967117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066624-f9ca-4c12-a3cd-bc94824d1cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:14.967399 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066624-f9ca-4c12-a3cd-bc94824d1cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:14.967671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab066624-f9ca-4c12-a3cd-bc94824d1cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:14.968364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066624-f9ca-4c12-a3cd-bc94824d1cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.969128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5944bc980b374729bb36a1becfe2554d, user_id=ba828c11574b4a7cbea949fc21a1b8d7, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:14.970154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:25:14.970154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 28 10:25:14.970154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: Aug 28 10:25:14.970435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab066624-f9ca-4c12-a3cd-bc94824d1cc7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:14.972332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.036382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 790/1574] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:14 2022] PUT /identity/v3/projects/5944bc980b374729bb36a1becfe2554d/users/ba828c11574b4a7cbea949fc21a1b8d7/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:15.037860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.049781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 785/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:14 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.050633 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066624-f9ca-4c12-a3cd-bc94824d1cc7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.105145 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6ba8f-5af6-49d7-a0f9-9faaaf48ff7f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.109820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb58135-da67-4b21-8143-e895568276bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.110470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb58135-da67-4b21-8143-e895568276bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.110749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb58135-da67-4b21-8143-e895568276bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.111021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb58135-da67-4b21-8143-e895568276bd admin admin] PATH_INFO: `/v3/projects/e2ee9e4da41d44d98b77499c24dc4114/users/32c57872abde449d9d6754dd63638fb0/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.111871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab066624-f9ca-4c12-a3cd-bc94824d1cc7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.118678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48888f-e106-46f6-bd79-c18dd2cba26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.119293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48888f-e106-46f6-bd79-c18dd2cba26e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.119572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48888f-e106-46f6-bd79-c18dd2cba26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.119844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48888f-e106-46f6-bd79-c18dd2cba26e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.120519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48888f-e106-46f6-bd79-c18dd2cba26e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.122463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48888f-e106-46f6-bd79-c18dd2cba26e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.127525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb58135-da67-4b21-8143-e895568276bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee9e4da41d44d98b77499c24dc4114, user_id=32c57872abde449d9d6754dd63638fb0, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.130339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb58135-da67-4b21-8143-e895568276bd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.225059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 791/1576] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:15 2022] PUT /identity/v3/projects/e2ee9e4da41d44d98b77499c24dc4114/users/32c57872abde449d9d6754dd63638fb0/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:15.226024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb58135-da67-4b21-8143-e895568276bd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.232259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:15.241333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 786/1577] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.241333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48888f-e106-46f6-bd79-c18dd2cba26e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.248946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48888f-e106-46f6-bd79-c18dd2cba26e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.262352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:15.294790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb58135-da67-4b21-8143-e895568276bd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.299774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd3d9-a55c-4164-ab4c-38316f48425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.300399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd3d9-a55c-4164-ab4c-38316f48425a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.300714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd3d9-a55c-4164-ab4c-38316f48425a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.300988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd3d9-a55c-4164-ab4c-38316f48425a admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.301622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd3d9-a55c-4164-ab4c-38316f48425a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.304219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd3d9-a55c-4164-ab4c-38316f48425a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.308666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8510-f36f-4b9f-a9f0-ae1833cf4ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.309363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8510-f36f-4b9f-a9f0-ae1833cf4ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.309616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8510-f36f-4b9f-a9f0-ae1833cf4ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.309891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d8510-f36f-4b9f-a9f0-ae1833cf4ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.310521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d8510-f36f-4b9f-a9f0-ae1833cf4ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.312445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d8510-f36f-4b9f-a9f0-ae1833cf4ba2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.402267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 792/1578] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.403103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd3d9-a55c-4164-ab4c-38316f48425a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.412884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd3d9-a55c-4164-ab4c-38316f48425a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.417945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ed376-ac2e-4b86-b2ab-14e56c966e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.418539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ed376-ac2e-4b86-b2ab-14e56c966e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.418824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ed376-ac2e-4b86-b2ab-14e56c966e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.419101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ed376-ac2e-4b86-b2ab-14e56c966e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.419749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ed376-ac2e-4b86-b2ab-14e56c966e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.421719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ed376-ac2e-4b86-b2ab-14e56c966e6d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.421829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 787/1579] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/projects => generated 391 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.425781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8510-f36f-4b9f-a9f0-ae1833cf4ba2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.488033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d8510-f36f-4b9f-a9f0-ae1833cf4ba2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.492972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad0181-462a-4d09-8bf9-84a92fa3361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.497234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0181-462a-4d09-8bf9-84a92fa3361f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.497234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0181-462a-4d09-8bf9-84a92fa3361f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.497234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0181-462a-4d09-8bf9-84a92fa3361f admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.497234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad0181-462a-4d09-8bf9-84a92fa3361f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.497234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad0181-462a-4d09-8bf9-84a92fa3361f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.524815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 793/1580] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.526081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96197a7b-9419-48de-84c5-1df3bbea9fe7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.526369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96197a7b-9419-48de-84c5-1df3bbea9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.526639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96197a7b-9419-48de-84c5-1df3bbea9fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.544911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-96197a7b-9419-48de-84c5-1df3bbea9fe7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:15.546099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-96197a7b-9419-48de-84c5-1df3bbea9fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:15.603805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 794/1581] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:15.604773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96197a7b-9419-48de-84c5-1df3bbea9fe7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.614511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96197a7b-9419-48de-84c5-1df3bbea9fe7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.620720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6b68e-8300-4608-bf73-68fb7edf172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.621331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b68e-8300-4608-bf73-68fb7edf172d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.621632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b68e-8300-4608-bf73-68fb7edf172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.621760 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 788/1582] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.621924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b68e-8300-4608-bf73-68fb7edf172d admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.622586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6b68e-8300-4608-bf73-68fb7edf172d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.623050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe272-c295-43ea-b43d-fac3e249d648 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.623340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe272-c295-43ea-b43d-fac3e249d648 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.623611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfe272-c295-43ea-b43d-fac3e249d648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.624587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6b68e-8300-4608-bf73-68fb7edf172d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.651867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-81cfe272-c295-43ea-b43d-fac3e249d648 None None] MFA Rules not processed for user `32c57872abde449d9d6754dd63638fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:15.653167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-81cfe272-c295-43ea-b43d-fac3e249d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:15.710920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 795/1583] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.711956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6b68e-8300-4608-bf73-68fb7edf172d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.716171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:15.719956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 789/1584] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:15.720713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe272-c295-43ea-b43d-fac3e249d648 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.721485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6b68e-8300-4608-bf73-68fb7edf172d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.778824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c8a01-e214-4b2f-9bc8-ec084fd9a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.779535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8a01-e214-4b2f-9bc8-ec084fd9a16e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.779821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8a01-e214-4b2f-9bc8-ec084fd9a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.780099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8a01-e214-4b2f-9bc8-ec084fd9a16e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.780784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c8a01-e214-4b2f-9bc8-ec084fd9a16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.782389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c8a01-e214-4b2f-9bc8-ec084fd9a16e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.784221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfe272-c295-43ea-b43d-fac3e249d648 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.789230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd77e34-4c81-4dd5-b6a4-013616a3ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.789871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77e34-4c81-4dd5-b6a4-013616a3ee3c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.790148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77e34-4c81-4dd5-b6a4-013616a3ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.790423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd77e34-4c81-4dd5-b6a4-013616a3ee3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.791074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd77e34-4c81-4dd5-b6a4-013616a3ee3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.792564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 796/1585] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:15.792752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd77e34-4c81-4dd5-b6a4-013616a3ee3c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.793425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c8a01-e214-4b2f-9bc8-ec084fd9a16e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.802862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c8a01-e214-4b2f-9bc8-ec084fd9a16e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.805741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 790/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:15.806468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd77e34-4c81-4dd5-b6a4-013616a3ee3c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.811078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c778f-39be-491d-baca-17bf6d53e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.811678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c778f-39be-491d-baca-17bf6d53e895 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.811960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c778f-39be-491d-baca-17bf6d53e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.812239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c778f-39be-491d-baca-17bf6d53e895 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.812904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c778f-39be-491d-baca-17bf6d53e895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.814815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c778f-39be-491d-baca-17bf6d53e895 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.815868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd77e34-4c81-4dd5-b6a4-013616a3ee3c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.821809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599419f-b734-447d-85bf-87a2cbbfca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.822395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599419f-b734-447d-85bf-87a2cbbfca2f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.822703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599419f-b734-447d-85bf-87a2cbbfca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.822969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599419f-b734-447d-85bf-87a2cbbfca2f admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.823602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599419f-b734-447d-85bf-87a2cbbfca2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.825705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599419f-b734-447d-85bf-87a2cbbfca2f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.826441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:15.929031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 797/1587] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.929859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c778f-39be-491d-baca-17bf6d53e895 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.957880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 791/1588] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:15.957880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599419f-b734-447d-85bf-87a2cbbfca2f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:15.968568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599419f-b734-447d-85bf-87a2cbbfca2f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.973456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42187a4a-4aa5-44cf-8f8e-941eeba105d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.974059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187a4a-4aa5-44cf-8f8e-941eeba105d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.974334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187a4a-4aa5-44cf-8f8e-941eeba105d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.974661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42187a4a-4aa5-44cf-8f8e-941eeba105d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:15.975408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42187a4a-4aa5-44cf-8f8e-941eeba105d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:15.977526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42187a4a-4aa5-44cf-8f8e-941eeba105d0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:15.986375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c778f-39be-491d-baca-17bf6d53e895 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:15.990351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b12d-b25b-4d66-982b-3588ca345aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:15.991574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b12d-b25b-4d66-982b-3588ca345aba service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:15.991856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b12d-b25b-4d66-982b-3588ca345aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:15.992125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b12d-b25b-4d66-982b-3588ca345aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.001208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b12d-b25b-4d66-982b-3588ca345aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.002679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b12d-b25b-4d66-982b-3588ca345aba service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.013241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 798/1589] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:16.014122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b12d-b25b-4d66-982b-3588ca345aba service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.023516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b12d-b25b-4d66-982b-3588ca345aba service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.028189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f55e0-1d71-42a9-933f-811e9b665b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.028815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f55e0-1d71-42a9-933f-811e9b665b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.029097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f55e0-1d71-42a9-933f-811e9b665b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.029455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f55e0-1d71-42a9-933f-811e9b665b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.030055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f55e0-1d71-42a9-933f-811e9b665b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.031734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f55e0-1d71-42a9-933f-811e9b665b15 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.042558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 799/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.043351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f55e0-1d71-42a9-933f-811e9b665b15 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.052677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f55e0-1d71-42a9-933f-811e9b665b15 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.057991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fcde9-d2bb-40b5-90ce-ebaf315d7b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.058509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fcde9-d2bb-40b5-90ce-ebaf315d7b1c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.058795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fcde9-d2bb-40b5-90ce-ebaf315d7b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.059073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fcde9-d2bb-40b5-90ce-ebaf315d7b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.059695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fcde9-d2bb-40b5-90ce-ebaf315d7b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.061601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fcde9-d2bb-40b5-90ce-ebaf315d7b1c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.094223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 792/1591] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:15 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:16.095083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42187a4a-4aa5-44cf-8f8e-941eeba105d0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.104845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42187a4a-4aa5-44cf-8f8e-941eeba105d0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.109377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0741d2b-c728-41cd-99ea-191a069e6074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.109949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0741d2b-c728-41cd-99ea-191a069e6074 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.110234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0741d2b-c728-41cd-99ea-191a069e6074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.110508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0741d2b-c728-41cd-99ea-191a069e6074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.111142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0741d2b-c728-41cd-99ea-191a069e6074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.112782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0741d2b-c728-41cd-99ea-191a069e6074 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.123709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 793/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.127654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0741d2b-c728-41cd-99ea-191a069e6074 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.137366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0741d2b-c728-41cd-99ea-191a069e6074 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.144161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224d0c-55ef-4a23-9f4e-f90c3393f9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.144161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224d0c-55ef-4a23-9f4e-f90c3393f9ff admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.144161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224d0c-55ef-4a23-9f4e-f90c3393f9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.144496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9224d0c-55ef-4a23-9f4e-f90c3393f9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.144944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9224d0c-55ef-4a23-9f4e-f90c3393f9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.146580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9224d0c-55ef-4a23-9f4e-f90c3393f9ff admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.159113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 794/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.159830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224d0c-55ef-4a23-9f4e-f90c3393f9ff admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.170733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9224d0c-55ef-4a23-9f4e-f90c3393f9ff admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.173234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 800/1594] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:16 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:16.174657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fcde9-d2bb-40b5-90ce-ebaf315d7b1c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.234833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5915-5643-480b-a92c-62a5153678a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.235441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5915-5643-480b-a92c-62a5153678a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.235718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5915-5643-480b-a92c-62a5153678a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.235994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e5915-5643-480b-a92c-62a5153678a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.236682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e5915-5643-480b-a92c-62a5153678a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.238328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e5915-5643-480b-a92c-62a5153678a6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.246189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fcde9-d2bb-40b5-90ce-ebaf315d7b1c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.248868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 795/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.249692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5915-5643-480b-a92c-62a5153678a6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.251732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109e5db-c58a-4d51-a7bd-ac7e4702e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.252374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109e5db-c58a-4d51-a7bd-ac7e4702e792 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.252685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109e5db-c58a-4d51-a7bd-ac7e4702e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.252959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109e5db-c58a-4d51-a7bd-ac7e4702e792 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.253689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109e5db-c58a-4d51-a7bd-ac7e4702e792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.255323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109e5db-c58a-4d51-a7bd-ac7e4702e792 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.261894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e5915-5643-480b-a92c-62a5153678a6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.267279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 801/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.268088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109e5db-c58a-4d51-a7bd-ac7e4702e792 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.268361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65a47-31ee-4f6b-bea9-ecb8c57f01fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.269013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65a47-31ee-4f6b-bea9-ecb8c57f01fe admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.269345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65a47-31ee-4f6b-bea9-ecb8c57f01fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.269542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65a47-31ee-4f6b-bea9-ecb8c57f01fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.270462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e65a47-31ee-4f6b-bea9-ecb8c57f01fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.272531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e65a47-31ee-4f6b-bea9-ecb8c57f01fe admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.280541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109e5db-c58a-4d51-a7bd-ac7e4702e792 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.284403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 796/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.285125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65a47-31ee-4f6b-bea9-ecb8c57f01fe admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.291128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1f61f-f522-4b01-90e2-024e5fffa206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.293199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1f61f-f522-4b01-90e2-024e5fffa206 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.293653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1f61f-f522-4b01-90e2-024e5fffa206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.294131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1f61f-f522-4b01-90e2-024e5fffa206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.294892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1f61f-f522-4b01-90e2-024e5fffa206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.296192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65a47-31ee-4f6b-bea9-ecb8c57f01fe admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.296743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1f61f-f522-4b01-90e2-024e5fffa206 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.301414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a76c1-ce54-4f06-a91d-a2e172f40094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.302145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a76c1-ce54-4f06-a91d-a2e172f40094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.302492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a76c1-ce54-4f06-a91d-a2e172f40094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.302952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a76c1-ce54-4f06-a91d-a2e172f40094 admin admin] PATH_INFO: `/v3/projects/431175fca4524b01a09f7d58fbbd8ca6/users/9e755fa1e0ec4820a476b9807dfc3d53/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.313091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 802/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.313922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1f61f-f522-4b01-90e2-024e5fffa206 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.323807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a76c1-ce54-4f06-a91d-a2e172f40094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431175fca4524b01a09f7d58fbbd8ca6, user_id=9e755fa1e0ec4820a476b9807dfc3d53, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.326620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a76c1-ce54-4f06-a91d-a2e172f40094 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.326971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1f61f-f522-4b01-90e2-024e5fffa206 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.333520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80b18-782a-4679-88b9-6d39e7dc2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.338340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80b18-782a-4679-88b9-6d39e7dc2b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.338340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80b18-782a-4679-88b9-6d39e7dc2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.338340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80b18-782a-4679-88b9-6d39e7dc2b4c admin admin] PATH_INFO: `/v3/projects/c00ba20608984f95b8d9c7a2a1a42387/users/e0f0bf68631642c197600f557e999adc/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.353564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db80b18-782a-4679-88b9-6d39e7dc2b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00ba20608984f95b8d9c7a2a1a42387, user_id=e0f0bf68631642c197600f557e999adc, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.356414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db80b18-782a-4679-88b9-6d39e7dc2b4c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.392644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:16.398403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 797/1599] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:16 2022] PUT /identity/v3/projects/431175fca4524b01a09f7d58fbbd8ca6/users/9e755fa1e0ec4820a476b9807dfc3d53/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:16.399269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a76c1-ce54-4f06-a91d-a2e172f40094 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.452135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 803/1600] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:16 2022] PUT /identity/v3/projects/c00ba20608984f95b8d9c7a2a1a42387/users/e0f0bf68631642c197600f557e999adc/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:16.452135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80b18-782a-4679-88b9-6d39e7dc2b4c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.462040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a76c1-ce54-4f06-a91d-a2e172f40094 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.484964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:16.525267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80b18-782a-4679-88b9-6d39e7dc2b4c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.530185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eaf96-da9e-4246-88a7-f03f0951e3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.530789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eaf96-da9e-4246-88a7-f03f0951e3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.531087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eaf96-da9e-4246-88a7-f03f0951e3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.531331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270eaf96-da9e-4246-88a7-f03f0951e3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.532022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eaf96-da9e-4246-88a7-f03f0951e3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.534663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270eaf96-da9e-4246-88a7-f03f0951e3ef admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.548445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c8b75-6573-4612-a56e-387e7940a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.548445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c8b75-6573-4612-a56e-387e7940a32f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.548445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c8b75-6573-4612-a56e-387e7940a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.548795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 804/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.548899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c8b75-6573-4612-a56e-387e7940a32f admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.548989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eaf96-da9e-4246-88a7-f03f0951e3ef admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.549082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c8b75-6573-4612-a56e-387e7940a32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.551170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c8b75-6573-4612-a56e-387e7940a32f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.560423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270eaf96-da9e-4246-88a7-f03f0951e3ef admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.565323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dd9e6-7051-4f5f-8dca-264103f66f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.565922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd9e6-7051-4f5f-8dca-264103f66f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.566234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd9e6-7051-4f5f-8dca-264103f66f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.566516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62dd9e6-7051-4f5f-8dca-264103f66f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.567175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dd9e6-7051-4f5f-8dca-264103f66f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.569426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62dd9e6-7051-4f5f-8dca-264103f66f36 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.579899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 805/1602] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.580705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dd9e6-7051-4f5f-8dca-264103f66f36 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.591028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62dd9e6-7051-4f5f-8dca-264103f66f36 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.595557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a8220-51d9-4f35-a82d-bae320772d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.603191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a8220-51d9-4f35-a82d-bae320772d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.603191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a8220-51d9-4f35-a82d-bae320772d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.603191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a8220-51d9-4f35-a82d-bae320772d45 admin admin] PATH_INFO: `/v3/projects/b70fb2c4286741c9bae4d8a08c36cc05/users/c8bb3c8ea6924563a923b9346bb3cd21/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.611748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a8220-51d9-4f35-a82d-bae320772d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70fb2c4286741c9bae4d8a08c36cc05, user_id=c8bb3c8ea6924563a923b9346bb3cd21, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.626532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a8220-51d9-4f35-a82d-bae320772d45 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.642765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 798/1603] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:16 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:16.645731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c8b75-6573-4612-a56e-387e7940a32f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.653538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c8b75-6573-4612-a56e-387e7940a32f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.658289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec2569-2672-4410-9952-269ad1711c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.659113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec2569-2672-4410-9952-269ad1711c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.659648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec2569-2672-4410-9952-269ad1711c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.660605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec2569-2672-4410-9952-269ad1711c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.661293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec2569-2672-4410-9952-269ad1711c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.663012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec2569-2672-4410-9952-269ad1711c32 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.673330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 799/1604] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:16.675013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d6c0f-f51b-4277-94f9-da2ba1b45d18 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.675343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d6c0f-f51b-4277-94f9-da2ba1b45d18 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.675613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d6c0f-f51b-4277-94f9-da2ba1b45d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.695051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fc2d6c0f-f51b-4277-94f9-da2ba1b45d18 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:16.696280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fc2d6c0f-f51b-4277-94f9-da2ba1b45d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:16.704383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 800/1605] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:16.706237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 806/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:16 2022] PUT /identity/v3/projects/b70fb2c4286741c9bae4d8a08c36cc05/users/c8bb3c8ea6924563a923b9346bb3cd21/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:16.706402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fb200-c9fc-4cae-999d-b0c9f59dfb36 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.706402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fb200-c9fc-4cae-999d-b0c9f59dfb36 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.706587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a8220-51d9-4f35-a82d-bae320772d45 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.706688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fb200-c9fc-4cae-999d-b0c9f59dfb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.733776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8d1fb200-c9fc-4cae-999d-b0c9f59dfb36 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:16.734986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8d1fb200-c9fc-4cae-999d-b0c9f59dfb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:16.779415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a8220-51d9-4f35-a82d-bae320772d45 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.784496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c787-c333-4ba4-9b8d-c9a26e29c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.785347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c787-c333-4ba4-9b8d-c9a26e29c391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.785641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c787-c333-4ba4-9b8d-c9a26e29c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.785912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c787-c333-4ba4-9b8d-c9a26e29c391 admin admin] PATH_INFO: `/v3/projects/3d842fc8902a470fbdd71a797552b51f/users/c6c7983040654f15ae92aea3511846de/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.798970 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 801/1607] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:16.802390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fb200-c9fc-4cae-999d-b0c9f59dfb36 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.802503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c787-c333-4ba4-9b8d-c9a26e29c391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d842fc8902a470fbdd71a797552b51f, user_id=c6c7983040654f15ae92aea3511846de, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.807437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105c787-c333-4ba4-9b8d-c9a26e29c391 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.814198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fb200-c9fc-4cae-999d-b0c9f59dfb36 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.819370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658a355-b7f3-4ca3-88c3-1f705e0e8024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:16.827215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658a355-b7f3-4ca3-88c3-1f705e0e8024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:16.827215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658a355-b7f3-4ca3-88c3-1f705e0e8024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:16.827215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658a355-b7f3-4ca3-88c3-1f705e0e8024 admin admin] PATH_INFO: `/v3/projects/ef88e96a0f204934b793789c582534be/users/4eb979b75c3a4a9ea25d90ff6e1ba24d/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:16.836969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658a355-b7f3-4ca3-88c3-1f705e0e8024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef88e96a0f204934b793789c582534be, user_id=4eb979b75c3a4a9ea25d90ff6e1ba24d, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:16.839750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658a355-b7f3-4ca3-88c3-1f705e0e8024 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:16.843145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:16.871936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 807/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:16 2022] PUT /identity/v3/projects/3d842fc8902a470fbdd71a797552b51f/users/c6c7983040654f15ae92aea3511846de/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:16.872936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c787-c333-4ba4-9b8d-c9a26e29c391 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.934843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 802/1609] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:16 2022] PUT /identity/v3/projects/ef88e96a0f204934b793789c582534be/users/4eb979b75c3a4a9ea25d90ff6e1ba24d/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:16.935821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658a355-b7f3-4ca3-88c3-1f705e0e8024 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:16.938702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105c787-c333-4ba4-9b8d-c9a26e29c391 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:16.958582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:16.996708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658a355-b7f3-4ca3-88c3-1f705e0e8024 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:17.001349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bb30b-e61c-49de-a27e-4ef099215333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.002002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bb30b-e61c-49de-a27e-4ef099215333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.002283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bb30b-e61c-49de-a27e-4ef099215333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.002557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bb30b-e61c-49de-a27e-4ef099215333 admin admin] PATH_INFO: `/v3/projects/bf95f1d5bc50429daaf2a105844bced4/users/af1ba83721894aebafdd9809d24365f5/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.002836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9158f-64f2-40dc-851a-3bb00cb550d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.003530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9158f-64f2-40dc-851a-3bb00cb550d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.003712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9158f-64f2-40dc-851a-3bb00cb550d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.003985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9158f-64f2-40dc-851a-3bb00cb550d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.004663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9158f-64f2-40dc-851a-3bb00cb550d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.006273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9158f-64f2-40dc-851a-3bb00cb550d6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.017105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 808/1610] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:17.018088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9158f-64f2-40dc-851a-3bb00cb550d6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:17.023146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bb30b-e61c-49de-a27e-4ef099215333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf95f1d5bc50429daaf2a105844bced4, user_id=af1ba83721894aebafdd9809d24365f5, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.026096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bb30b-e61c-49de-a27e-4ef099215333 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.080985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9158f-64f2-40dc-851a-3bb00cb550d6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:17.085027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074a8bb-3292-42b6-be36-d19c11cff094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.085637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074a8bb-3292-42b6-be36-d19c11cff094 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.085919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074a8bb-3292-42b6-be36-d19c11cff094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.086195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074a8bb-3292-42b6-be36-d19c11cff094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.095561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074a8bb-3292-42b6-be36-d19c11cff094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.097151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074a8bb-3292-42b6-be36-d19c11cff094 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.107042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 809/1611] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:17.108393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148047e-f7d6-4b4e-a744-d5e3e47c4836 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.108740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148047e-f7d6-4b4e-a744-d5e3e47c4836 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.109023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148047e-f7d6-4b4e-a744-d5e3e47c4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.137410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b148047e-f7d6-4b4e-a744-d5e3e47c4836 None None] MFA Rules not processed for user `c8bb3c8ea6924563a923b9346bb3cd21`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:17.138627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b148047e-f7d6-4b4e-a744-d5e3e47c4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:17.152684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 803/1612] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:16 2022] PUT /identity/v3/projects/bf95f1d5bc50429daaf2a105844bced4/users/af1ba83721894aebafdd9809d24365f5/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:17.153710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bb30b-e61c-49de-a27e-4ef099215333 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:17.214421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bb30b-e61c-49de-a27e-4ef099215333 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:17.218616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 810/1613] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:17.219791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552a2b3-cbb6-4dfc-8c69-2f8fd0d02a06 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.220187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552a2b3-cbb6-4dfc-8c69-2f8fd0d02a06 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.220580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552a2b3-cbb6-4dfc-8c69-2f8fd0d02a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.223189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c31acd-30f8-4551-bd3d-6e531ff73af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.224248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31acd-30f8-4551-bd3d-6e531ff73af7 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.224628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31acd-30f8-4551-bd3d-6e531ff73af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.225486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31acd-30f8-4551-bd3d-6e531ff73af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.253292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7552a2b3-cbb6-4dfc-8c69-2f8fd0d02a06 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:17.254663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7552a2b3-cbb6-4dfc-8c69-2f8fd0d02a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:17.325273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:17.329552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c31acd-30f8-4551-bd3d-6e531ff73af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.331197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c31acd-30f8-4551-bd3d-6e531ff73af7 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.345267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 804/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:17.357890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510aee-af77-4594-a8b7-6b137c1874cd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.361150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 811/1615] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:17.362164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552a2b3-cbb6-4dfc-8c69-2f8fd0d02a06 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:17.364599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510aee-af77-4594-a8b7-6b137c1874cd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.364754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da510aee-af77-4594-a8b7-6b137c1874cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.380231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552a2b3-cbb6-4dfc-8c69-2f8fd0d02a06 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:17.385889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd4ffd-1dd4-4707-8007-87d7cde5d71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.386563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd4ffd-1dd4-4707-8007-87d7cde5d71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.386846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd4ffd-1dd4-4707-8007-87d7cde5d71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.387122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd4ffd-1dd4-4707-8007-87d7cde5d71f admin admin] PATH_INFO: `/v3/projects/a90881ae1bc44b508316aa1525b77263/users/6345099a38a7490da823d0301f3ce223/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.400015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-da510aee-af77-4594-a8b7-6b137c1874cd None None] MFA Rules not processed for user `4eb979b75c3a4a9ea25d90ff6e1ba24d`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:17.401606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da510aee-af77-4594-a8b7-6b137c1874cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:17.404198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd4ffd-1dd4-4707-8007-87d7cde5d71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90881ae1bc44b508316aa1525b77263, user_id=6345099a38a7490da823d0301f3ce223, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.407009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd4ffd-1dd4-4707-8007-87d7cde5d71f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.420263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:17.480608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 805/1616] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:17.480608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4c5e-c958-478f-a5b9-f8d7103924c4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.480608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4c5e-c958-478f-a5b9-f8d7103924c4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.480608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4c5e-c958-478f-a5b9-f8d7103924c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.497987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 812/1617] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:17 2022] PUT /identity/v3/projects/a90881ae1bc44b508316aa1525b77263/users/6345099a38a7490da823d0301f3ce223/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:17.499288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4a243-df7e-460b-8782-6c58d5cc3f74 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.499580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4a243-df7e-460b-8782-6c58d5cc3f74 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.499886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4a243-df7e-460b-8782-6c58d5cc3f74 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.501138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 813/1618] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 28 10:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:25:17.501893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4a243-df7e-460b-8782-6c58d5cc3f74 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:17.523384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-bf2e4c5e-c958-478f-a5b9-f8d7103924c4 None None] MFA Rules not processed for user `af1ba83721894aebafdd9809d24365f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:17.525703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bf2e4c5e-c958-478f-a5b9-f8d7103924c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:17.617964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 806/1619] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:17.619147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e4c5e-c958-478f-a5b9-f8d7103924c4 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:17.639756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4a243-df7e-460b-8782-6c58d5cc3f74 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:17.648631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471791c-2a22-463d-b63b-5c6e2ebabe45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.654146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471791c-2a22-463d-b63b-5c6e2ebabe45 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.654146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471791c-2a22-463d-b63b-5c6e2ebabe45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.654146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471791c-2a22-463d-b63b-5c6e2ebabe45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.766322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e4c5e-c958-478f-a5b9-f8d7103924c4 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:17.775181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471791c-2a22-463d-b63b-5c6e2ebabe45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.779719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471791c-2a22-463d-b63b-5c6e2ebabe45 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.781491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f2db-fa4c-47be-bbc7-93d7bac81580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.782126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f2db-fa4c-47be-bbc7-93d7bac81580 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.782393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f2db-fa4c-47be-bbc7-93d7bac81580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.782666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f2db-fa4c-47be-bbc7-93d7bac81580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.783360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20f2db-fa4c-47be-bbc7-93d7bac81580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.785047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20f2db-fa4c-47be-bbc7-93d7bac81580 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.790380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 814/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:17.791773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2c5e3-94d9-4a04-a5ee-e5f0489caaa7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.792057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2c5e3-94d9-4a04-a5ee-e5f0489caaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.792709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2c5e3-94d9-4a04-a5ee-e5f0489caaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.807471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 807/1621] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:17.811728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892190b1-ebfd-49ee-88fb-b4a340401691 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.813114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892190b1-ebfd-49ee-88fb-b4a340401691 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.813407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892190b1-ebfd-49ee-88fb-b4a340401691 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.820409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 808/1622] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 28 10:25:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:25:17.821337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892190b1-ebfd-49ee-88fb-b4a340401691 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:17.851247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fce2c5e3-94d9-4a04-a5ee-e5f0489caaa7 None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:17.852531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892190b1-ebfd-49ee-88fb-b4a340401691 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:17.853612 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fce2c5e3-94d9-4a04-a5ee-e5f0489caaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:17.858492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1edb3-8780-4a35-b470-46ec1c77175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.859107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1edb3-8780-4a35-b470-46ec1c77175f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.861940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1edb3-8780-4a35-b470-46ec1c77175f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.861940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1edb3-8780-4a35-b470-46ec1c77175f admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.861940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1edb3-8780-4a35-b470-46ec1c77175f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.862312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1edb3-8780-4a35-b470-46ec1c77175f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.921238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:17.938298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 815/1623] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:17.939111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2c5e3-94d9-4a04-a5ee-e5f0489caaa7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:17.950518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2c5e3-94d9-4a04-a5ee-e5f0489caaa7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:17.955239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9bd50-a803-40ae-bb61-d95232102bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:17.955919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9bd50-a803-40ae-bb61-d95232102bde admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.956205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9bd50-a803-40ae-bb61-d95232102bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.956515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9bd50-a803-40ae-bb61-d95232102bde admin admin] PATH_INFO: `/v3/projects/a90881ae1bc44b508316aa1525b77263/users/6345099a38a7490da823d0301f3ce223/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.958519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9bd50-a803-40ae-bb61-d95232102bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90881ae1bc44b508316aa1525b77263, user_id=6345099a38a7490da823d0301f3ce223, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:17.962156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9bd50-a803-40ae-bb61-d95232102bde admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:17.979125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 809/1624] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:17 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:17.983611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7ea0-c8d6-4b89-b09b-df014e3cf904 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:17.984136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7ea0-c8d6-4b89-b09b-df014e3cf904 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:17.984548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7ea0-c8d6-4b89-b09b-df014e3cf904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:17.991651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 816/1625] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:17 2022] PUT /identity/v3/projects/a90881ae1bc44b508316aa1525b77263/users/6345099a38a7490da823d0301f3ce223/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:17.993798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9bd50-a803-40ae-bb61-d95232102bde admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.010400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d77e7ea0-c8d6-4b89-b09b-df014e3cf904 None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:18.011961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d77e7ea0-c8d6-4b89-b09b-df014e3cf904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:18.097566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9bd50-a803-40ae-bb61-d95232102bde admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:18.098150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 810/1626] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 28 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:18.099062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7ea0-c8d6-4b89-b09b-df014e3cf904 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.116414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be7484-eb2e-40a6-b9ef-659219bc6c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:18.117881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be7484-eb2e-40a6-b9ef-659219bc6c6c service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.118602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be7484-eb2e-40a6-b9ef-659219bc6c6c service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.122218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be7484-eb2e-40a6-b9ef-659219bc6c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.188929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7ea0-c8d6-4b89-b09b-df014e3cf904 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:18.202034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16b89-249d-44e5-b07e-06c5f964fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:18.202302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16b89-249d-44e5-b07e-06c5f964fe80 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.202463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16b89-249d-44e5-b07e-06c5f964fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.202740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b16b89-249d-44e5-b07e-06c5f964fe80 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.203403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b16b89-249d-44e5-b07e-06c5f964fe80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:18.204602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be7484-eb2e-40a6-b9ef-659219bc6c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:18.207073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be7484-eb2e-40a6-b9ef-659219bc6c6c service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:18.208766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b16b89-249d-44e5-b07e-06c5f964fe80 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:18.219747 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 817/1627] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:18.236200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc4a3-aae1-4c09-b957-0208a3520d5c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.237764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc4a3-aae1-4c09-b957-0208a3520d5c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.238420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc4a3-aae1-4c09-b957-0208a3520d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.300349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:18.312911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4bfbc4a3-aae1-4c09-b957-0208a3520d5c None None] MFA Rules not processed for user `6345099a38a7490da823d0301f3ce223`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:18.314819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4bfbc4a3-aae1-4c09-b957-0208a3520d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:18.364306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 811/1628] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:18 2022] POST /identity/v3/users => generated 298 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:18.366153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16b89-249d-44e5-b07e-06c5f964fe80 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.409307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b16b89-249d-44e5-b07e-06c5f964fe80 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:18.426560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b4469-02ee-4129-96b0-c128ff5ebf4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:18.427193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b4469-02ee-4129-96b0-c128ff5ebf4a service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.427471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b4469-02ee-4129-96b0-c128ff5ebf4a service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.427740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b4469-02ee-4129-96b0-c128ff5ebf4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.454429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 818/1629] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:18.455820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc4a3-aae1-4c09-b957-0208a3520d5c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.500471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc4a3-aae1-4c09-b957-0208a3520d5c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:18.509500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b4469-02ee-4129-96b0-c128ff5ebf4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:18.509597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ad45-d047-47a2-b243-54a2196f4f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:18.509700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b4469-02ee-4129-96b0-c128ff5ebf4a service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:18.509777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ad45-d047-47a2-b243-54a2196f4f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.509777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ad45-d047-47a2-b243-54a2196f4f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.509777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ad45-d047-47a2-b243-54a2196f4f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.510002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ad45-d047-47a2-b243-54a2196f4f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:18.511854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ad45-d047-47a2-b243-54a2196f4f01 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:18.526379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 819/1630] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:18.528054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ad45-d047-47a2-b243-54a2196f4f01 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.536381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 812/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:18.537976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b4469-02ee-4129-96b0-c128ff5ebf4a service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.572922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b4469-02ee-4129-96b0-c128ff5ebf4a service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:18.584721 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dbd7-5378-437e-bb7c-d64e7e8d8c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:18.587122 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dbd7-5378-437e-bb7c-d64e7e8d8c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.587421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dbd7-5378-437e-bb7c-d64e7e8d8c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.587703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4dbd7-5378-437e-bb7c-d64e7e8d8c11 admin admin] PATH_INFO: `/v3/projects/9a4e9277bbe44a3795a11bd06c1dcdf3/users/866c9fb197894ca3b24cc32f9dbab86c/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.617023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ad45-d047-47a2-b243-54a2196f4f01 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:18.621280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c5400-ea98-4fa1-b4de-714ad0e488cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:18.622320 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4dbd7-5378-437e-bb7c-d64e7e8d8c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4e9277bbe44a3795a11bd06c1dcdf3, user_id=866c9fb197894ca3b24cc32f9dbab86c, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:18.622856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5400-ea98-4fa1-b4de-714ad0e488cb service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.623194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5400-ea98-4fa1-b4de-714ad0e488cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.623510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5400-ea98-4fa1-b4de-714ad0e488cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.630711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4dbd7-5378-437e-bb7c-d64e7e8d8c11 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:18.636220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c5400-ea98-4fa1-b4de-714ad0e488cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:18.637928 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c5400-ea98-4fa1-b4de-714ad0e488cb service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:18.661764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 820/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:18.665823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2d78-540b-4a09-bd33-ef54c4691e7a None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.667023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2d78-540b-4a09-bd33-ef54c4691e7a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.667309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af2d78-540b-4a09-bd33-ef54c4691e7a None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.678535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 821/1633] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 10:25:18 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:25:18.683335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b9f1-6157-45f6-8aef-82f48aa15e46 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.683948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b9f1-6157-45f6-8aef-82f48aa15e46 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.684488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6b9f1-6157-45f6-8aef-82f48aa15e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.696206 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 813/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:18 2022] PUT /identity/v3/projects/9a4e9277bbe44a3795a11bd06c1dcdf3/users/866c9fb197894ca3b24cc32f9dbab86c/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:18.700117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dbd7-5378-437e-bb7c-d64e7e8d8c11 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.719511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:18.749562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ecc6b9f1-6157-45f6-8aef-82f48aa15e46 None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:18.753033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ecc6b9f1-6157-45f6-8aef-82f48aa15e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:18.883470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4dbd7-5378-437e-bb7c-d64e7e8d8c11 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:18.895779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfbc5-f655-412a-bfa6-640f172c8272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:18.897012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfbc5-f655-412a-bfa6-640f172c8272 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.897258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfbc5-f655-412a-bfa6-640f172c8272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.897532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dfbc5-f655-412a-bfa6-640f172c8272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.898214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfbc5-f655-412a-bfa6-640f172c8272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:18.899909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dfbc5-f655-412a-bfa6-640f172c8272 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:18.913982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 814/1635] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:25:18.916939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfbc5-f655-412a-bfa6-640f172c8272 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.927327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dfbc5-f655-412a-bfa6-640f172c8272 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:18.933224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3742291-0aa7-466d-934a-84be056d4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:18.935097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742291-0aa7-466d-934a-84be056d4b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.935097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742291-0aa7-466d-934a-84be056d4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.935097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742291-0aa7-466d-934a-84be056d4b13 admin admin] PATH_INFO: `/v3/projects/9a4e9277bbe44a3795a11bd06c1dcdf3/users/866c9fb197894ca3b24cc32f9dbab86c/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:18.942395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3742291-0aa7-466d-934a-84be056d4b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4e9277bbe44a3795a11bd06c1dcdf3, user_id=866c9fb197894ca3b24cc32f9dbab86c, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:18.949361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3742291-0aa7-466d-934a-84be056d4b13 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:18.974442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 815/1636] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:18 2022] PUT /identity/v3/projects/9a4e9277bbe44a3795a11bd06c1dcdf3/users/866c9fb197894ca3b24cc32f9dbab86c/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:18.991531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 822/1637] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:18.992879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf3ad4-c49a-424d-8f8b-e327e0794bee None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:18.993225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf3ad4-c49a-424d-8f8b-e327e0794bee None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:18.994264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6b9f1-6157-45f6-8aef-82f48aa15e46 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:18.995250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf3ad4-c49a-424d-8f8b-e327e0794bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:19.038378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:19.176836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1fcf3ad4-c49a-424d-8f8b-e327e0794bee None None] MFA Rules not processed for user `866c9fb197894ca3b24cc32f9dbab86c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:19.176836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1fcf3ad4-c49a-424d-8f8b-e327e0794bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:19.203397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6b9f1-6157-45f6-8aef-82f48aa15e46 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:19.271156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 816/1638] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:19.273706 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467640b-159e-48e0-b706-6b534d63b4f1 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:19.274087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467640b-159e-48e0-b706-6b534d63b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:19.274571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467640b-159e-48e0-b706-6b534d63b4f1 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:19.281268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 817/1639] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 10:25:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:25:19.281966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467640b-159e-48e0-b706-6b534d63b4f1 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:19.315633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85c7da-7aee-43f3-bf91-b5e6787dd750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:19.316845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85c7da-7aee-43f3-bf91-b5e6787dd750 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:19.320570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85c7da-7aee-43f3-bf91-b5e6787dd750 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:19.321086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85c7da-7aee-43f3-bf91-b5e6787dd750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:19.382362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467640b-159e-48e0-b706-6b534d63b4f1 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:19.386961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef691-00de-4001-b1bc-15aee29f3286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:19.387674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef691-00de-4001-b1bc-15aee29f3286 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:19.388026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef691-00de-4001-b1bc-15aee29f3286 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:19.388435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef691-00de-4001-b1bc-15aee29f3286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:19.429547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85c7da-7aee-43f3-bf91-b5e6787dd750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:19.431083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85c7da-7aee-43f3-bf91-b5e6787dd750 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:19.445400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 823/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:19.446489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf225-ebff-463f-a947-aa9ae3cbcbbf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:19.446775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf225-ebff-463f-a947-aa9ae3cbcbbf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:19.447083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdaf225-ebff-463f-a947-aa9ae3cbcbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:19.482251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5cdaf225-ebff-463f-a947-aa9ae3cbcbbf None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:19.483629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5cdaf225-ebff-463f-a947-aa9ae3cbcbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:19.488726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ef691-00de-4001-b1bc-15aee29f3286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:19.490742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ef691-00de-4001-b1bc-15aee29f3286 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:19.501315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 818/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:19.538759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 824/1642] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:19.837764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:20.281291 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef691-00de-4001-b1bc-15aee29f3286 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:20.297767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef691-00de-4001-b1bc-15aee29f3286 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:20.306588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:20.309046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6edcef-50da-40b8-9405-6b15eccc4bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:20.309906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6edcef-50da-40b8-9405-6b15eccc4bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:20.310349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6edcef-50da-40b8-9405-6b15eccc4bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:20.311145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6edcef-50da-40b8-9405-6b15eccc4bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:20.331055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6edcef-50da-40b8-9405-6b15eccc4bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:20.332674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6edcef-50da-40b8-9405-6b15eccc4bb4 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:20.356191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 819/1643] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:20.399093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaf225-ebff-463f-a947-aa9ae3cbcbbf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:20.421277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdaf225-ebff-463f-a947-aa9ae3cbcbbf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:20.425439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709f41e-c34c-406b-8024-922bfa361a4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:20.426058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709f41e-c34c-406b-8024-922bfa361a4d service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:20.426335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709f41e-c34c-406b-8024-922bfa361a4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:20.426607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709f41e-c34c-406b-8024-922bfa361a4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:20.440961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709f41e-c34c-406b-8024-922bfa361a4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:20.442639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709f41e-c34c-406b-8024-922bfa361a4d service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:20.455690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 825/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:21.795661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6edcef-50da-40b8-9405-6b15eccc4bb4 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:21.806284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6edcef-50da-40b8-9405-6b15eccc4bb4 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:21.810579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00319c68-4622-4b12-a0ab-835f253baa92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:21.811371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319c68-4622-4b12-a0ab-835f253baa92 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:21.811653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319c68-4622-4b12-a0ab-835f253baa92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:21.811923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00319c68-4622-4b12-a0ab-835f253baa92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:21.923168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00319c68-4622-4b12-a0ab-835f253baa92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:21.927150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00319c68-4622-4b12-a0ab-835f253baa92 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:21.975573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 820/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:25.029245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709f41e-c34c-406b-8024-922bfa361a4d service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:25.235690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709f41e-c34c-406b-8024-922bfa361a4d service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:25.258016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:25.259308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:25.259308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:25.259308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] PATH_INFO: `/v3/users/c8bb3c8ea6924563a923b9346bb3cd21` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:25.260607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8bb3c8ea6924563a923b9346bb3cd21)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:25.262133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: WARNING py.warnings [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:25:25.262133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: warnings.warn(msg) Aug 28 10:25:25.262133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: Aug 28 10:25:25.265463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:25.586809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8bb3c8ea6924563a923b9346bb3cd21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:25.620132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8bb3c8ea6924563a923b9346bb3cd21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:25.632596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:25.659111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8bb3c8ea6924563a923b9346bb3cd21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:25.779620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8bb3c8ea6924563a923b9346bb3cd21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:25.780424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8bb3c8ea6924563a923b9346bb3cd21'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:25.787919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 826/1646] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:25 2022] DELETE /identity/v3/users/c8bb3c8ea6924563a923b9346bb3cd21 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:25.793806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ab89-d870-41a1-a773-8555db5ffa94 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:25.794331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ab89-d870-41a1-a773-8555db5ffa94 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:25.794560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ab89-d870-41a1-a773-8555db5ffa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:25.839173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1052ab89-d870-41a1-a773-8555db5ffa94 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:25.839173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1052ab89-d870-41a1-a773-8555db5ffa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:26.040341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 821/1647] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:26.138279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:26.140116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:26.299425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc239d49-dd91-405b-8741-8e41a1f56557 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:26.309371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc73560-c7c1-4974-afac-9a69e1bbf602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:26.310277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc73560-c7c1-4974-afac-9a69e1bbf602 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:26.310743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc73560-c7c1-4974-afac-9a69e1bbf602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:26.311879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc73560-c7c1-4974-afac-9a69e1bbf602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:26.353455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc73560-c7c1-4974-afac-9a69e1bbf602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:26.360794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc73560-c7c1-4974-afac-9a69e1bbf602 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:26.383968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 827/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:26.670888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052ab89-d870-41a1-a773-8555db5ffa94 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:26.673397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1052ab89-d870-41a1-a773-8555db5ffa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:26.703500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052ab89-d870-41a1-a773-8555db5ffa94 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:26.740788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:26.741440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:26.741722 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:26.742000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] PATH_INFO: `/v3/users/af1ba83721894aebafdd9809d24365f5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:26.748818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1ba83721894aebafdd9809d24365f5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:26.751440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:26.889241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85751c-84f8-46f4-8851-a76e4367461f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:26.889712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85751c-84f8-46f4-8851-a76e4367461f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:26.890306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85751c-84f8-46f4-8851-a76e4367461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:26.965908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4f85751c-84f8-46f4-8851-a76e4367461f None None] MFA Rules not processed for user `ba828c11574b4a7cbea949fc21a1b8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:26.967682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4f85751c-84f8-46f4-8851-a76e4367461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:27.026309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1ba83721894aebafdd9809d24365f5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:27.049627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1ba83721894aebafdd9809d24365f5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:27.055923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:27.117712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 828/1649] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:27.128959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a429d3-b490-4b2f-a171-0aa1a33ac6f4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:27.129276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a429d3-b490-4b2f-a171-0aa1a33ac6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:27.129566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a429d3-b490-4b2f-a171-0aa1a33ac6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:27.162727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1ba83721894aebafdd9809d24365f5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:27.182550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-88a429d3-b490-4b2f-a171-0aa1a33ac6f4 None None] MFA Rules not processed for user `ba828c11574b4a7cbea949fc21a1b8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:27.185590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88a429d3-b490-4b2f-a171-0aa1a33ac6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:27.190570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1ba83721894aebafdd9809d24365f5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:27.192363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-916b67e1-d35d-47fa-b308-66804c4cb083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1ba83721894aebafdd9809d24365f5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:27.205021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 829/1650] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:27.214503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 822/1651] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:26 2022] DELETE /identity/v3/users/af1ba83721894aebafdd9809d24365f5 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:27.218465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a429d3-b490-4b2f-a171-0aa1a33ac6f4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:27.220084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88a429d3-b490-4b2f-a171-0aa1a33ac6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:27.220929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a7ec-7aea-4a90-ae47-b0cd555447b5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:27.221212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a7ec-7aea-4a90-ae47-b0cd555447b5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:27.221479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0a7ec-7aea-4a90-ae47-b0cd555447b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:27.272755 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fdf0a7ec-7aea-4a90-ae47-b0cd555447b5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:27.274753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fdf0a7ec-7aea-4a90-ae47-b0cd555447b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:27.352993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:27.368755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a429d3-b490-4b2f-a171-0aa1a33ac6f4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:27.378575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 823/1652] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:27.471664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0a7ec-7aea-4a90-ae47-b0cd555447b5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:27.473190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fdf0a7ec-7aea-4a90-ae47-b0cd555447b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:27.508875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:27.509625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:27.511399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:27.513307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:27.520198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:27.600167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0a7ec-7aea-4a90-ae47-b0cd555447b5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:27.616867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:27.617491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:27.617864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:27.618233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:27.644684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:27.646300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:27.668050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 824/1653] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:27.668963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:27.675993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:27.709286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9452f8-38b1-4143-b98a-54c1125cbfd4 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:27.722159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:27.722813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:27.723089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:27.723362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] PATH_INFO: `/v3/projects/b70fb2c4286741c9bae4d8a08c36cc05` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:27.729201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70fb2c4286741c9bae4d8a08c36cc05)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:27.730249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: WARNING py.warnings [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 10:25:27.730249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: warnings.warn(msg) Aug 28 10:25:27.730249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: Aug 28 10:25:27.731479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:27.757036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:27.766113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:27.815769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 830/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:27.927855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70fb2c4286741c9bae4d8a08c36cc05', 'request_id': 'req-17d94a12-4fd0-4509-a440-f6fe0e273f21'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.027937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70fb2c4286741c9bae4d8a08c36cc05', 'request_id': 'req-17d94a12-4fd0-4509-a440-f6fe0e273f21'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.063370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70fb2c4286741c9bae4d8a08c36cc05', 'request_id': 'req-17d94a12-4fd0-4509-a440-f6fe0e273f21'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.125072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:28.126663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:28.149486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] The token cache is being invalidate because project b70fb2c4286741c9bae4d8a08c36cc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:28.149977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.150845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-17d94a12-4fd0-4509-a440-f6fe0e273f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.152898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 825/1655] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:27 2022] DELETE /identity/v3/projects/b70fb2c4286741c9bae4d8a08c36cc05 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:28.157101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36477c8-ca6b-4390-a2af-a3c019852f5a service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:28.157884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6ee5-bab8-4bed-be3d-e8fa8c73c25e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:28.158341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6ee5-bab8-4bed-be3d-e8fa8c73c25e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:28.158626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6ee5-bab8-4bed-be3d-e8fa8c73c25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:28.226337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-869b6ee5-bab8-4bed-be3d-e8fa8c73c25e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:28.227312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-869b6ee5-bab8-4bed-be3d-e8fa8c73c25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:28.287486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:28.289071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:28.289486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:28.289840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] PATH_INFO: `/v3/users/4eb979b75c3a4a9ea25d90ff6e1ba24d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:28.291230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eb979b75c3a4a9ea25d90ff6e1ba24d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:28.294549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:28.381544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 826/1656] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:28.388273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24892e-0636-499d-a79a-0ce61d2b8874 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:28.388675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24892e-0636-499d-a79a-0ce61d2b8874 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:28.389065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24892e-0636-499d-a79a-0ce61d2b8874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:28.432244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-df24892e-0636-499d-a79a-0ce61d2b8874 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:28.435126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-df24892e-0636-499d-a79a-0ce61d2b8874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:28.451860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 827/1657] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:28.453641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24892e-0636-499d-a79a-0ce61d2b8874 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:28.468957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24892e-0636-499d-a79a-0ce61d2b8874 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:28.478856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:28.479759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:28.480252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:28.486966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:28.487895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:28.489048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:28.492226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:28.519330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 828/1658] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:28.526455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:28.554146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636bfdf-1967-494c-98e4-d3a3bc997177 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:28.564712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eb979b75c3a4a9ea25d90ff6e1ba24d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.571566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf9550-55ee-446e-bc94-a6f717853074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:28.572394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9550-55ee-446e-bc94-a6f717853074 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:28.572878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9550-55ee-446e-bc94-a6f717853074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:28.574499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf9550-55ee-446e-bc94-a6f717853074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:28.574499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf9550-55ee-446e-bc94-a6f717853074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:28.576411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf9550-55ee-446e-bc94-a6f717853074 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:28.593736 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eb979b75c3a4a9ea25d90ff6e1ba24d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.616183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eb979b75c3a4a9ea25d90ff6e1ba24d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.719519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 829/1659] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:28 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:28.720813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf9550-55ee-446e-bc94-a6f717853074 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:28.734267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eb979b75c3a4a9ea25d90ff6e1ba24d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.734800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-615f4d58-916e-4a6d-bf5d-6ebdddea2c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eb979b75c3a4a9ea25d90ff6e1ba24d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:28.743235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 831/1660] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:28 2022] DELETE /identity/v3/users/4eb979b75c3a4a9ea25d90ff6e1ba24d => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:28.748807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06bf72-141f-4733-adeb-7a88d4d8b614 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:28.749208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06bf72-141f-4733-adeb-7a88d4d8b614 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:28.749460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06bf72-141f-4733-adeb-7a88d4d8b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:28.788255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4b06bf72-141f-4733-adeb-7a88d4d8b614 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:28.794376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4b06bf72-141f-4733-adeb-7a88d4d8b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:28.899830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf9550-55ee-446e-bc94-a6f717853074 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:28.907291 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:28.954400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 832/1661] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:29.031621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:29.032951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.033429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.033921 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.034785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:29.038035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:29.150879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06bf72-141f-4733-adeb-7a88d4d8b614 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:29.152280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4b06bf72-141f-4733-adeb-7a88d4d8b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:29.156482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 830/1662] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:28 2022] POST /identity/v3/users => generated 287 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:29.157645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:29.161617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:29.170486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06bf72-141f-4733-adeb-7a88d4d8b614 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:29.186323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a5db-71ce-4e7a-bc4c-a38df00e5a7b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:29.189616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:29.191161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.191434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.191716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] PATH_INFO: `/v3/projects/bf95f1d5bc50429daaf2a105844bced4` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.192952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf95f1d5bc50429daaf2a105844bced4)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:29.196677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:29.197808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:29.198550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.199631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.200112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.201585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:29.206377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:29.229766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 831/1663] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:25:29.233005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:29.242467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:29.252767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:29.376207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f797c-744a-41cf-840b-25534704a339 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:29.410871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf95f1d5bc50429daaf2a105844bced4', 'request_id': 'req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:29.430679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf95f1d5bc50429daaf2a105844bced4', 'request_id': 'req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:29.446822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf95f1d5bc50429daaf2a105844bced4', 'request_id': 'req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:29.469670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853daf-5a5e-478a-ae4a-c6d27af7e658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:29.471396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853daf-5a5e-478a-ae4a-c6d27af7e658 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.471828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853daf-5a5e-478a-ae4a-c6d27af7e658 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.472378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853daf-5a5e-478a-ae4a-c6d27af7e658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.546512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] The token cache is being invalidate because project bf95f1d5bc50429daaf2a105844bced4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:29.548218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:29.548218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:29.553741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 833/1664] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:29 2022] DELETE /identity/v3/projects/bf95f1d5bc50429daaf2a105844bced4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:29.554713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:29.558452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:29.575758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5853daf-5a5e-478a-ae4a-c6d27af7e658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:29.578005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5853daf-5a5e-478a-ae4a-c6d27af7e658 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:29.591979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a87c6-efb2-4ac6-a030-3a1db0ce7087 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:29.601952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 832/1665] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:29.605676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a82b-46b9-49c1-b275-d7ff1fd89e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:29.605821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853daf-5a5e-478a-ae4a-c6d27af7e658 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:29.605909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a82b-46b9-49c1-b275-d7ff1fd89e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.605909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a82b-46b9-49c1-b275-d7ff1fd89e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.605909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a82b-46b9-49c1-b275-d7ff1fd89e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.608652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a82b-46b9-49c1-b275-d7ff1fd89e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:29.614291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a82b-46b9-49c1-b275-d7ff1fd89e30 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:29.615775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5853daf-5a5e-478a-ae4a-c6d27af7e658 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:29.623980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:29.625397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.626273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.626696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] PATH_INFO: `/v3/users/866c9fb197894ca3b24cc32f9dbab86c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.628229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=866c9fb197894ca3b24cc32f9dbab86c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:29.631920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:29.636681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 834/1666] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:29.642136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a82b-46b9-49c1-b275-d7ff1fd89e30 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:29.670234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a82b-46b9-49c1-b275-d7ff1fd89e30 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:29.682453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a3ec6-e215-4866-9f71-5284d5acc51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:29.683122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3ec6-e215-4866-9f71-5284d5acc51e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.683329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3ec6-e215-4866-9f71-5284d5acc51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.683600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a3ec6-e215-4866-9f71-5284d5acc51e admin admin] PATH_INFO: `/v3/projects/e1e6c2f629c24254b61df09178ba2981/users/51ea75f1153a4076adc9bd0e1d77bc24/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.724055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a3ec6-e215-4866-9f71-5284d5acc51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e6c2f629c24254b61df09178ba2981, user_id=51ea75f1153a4076adc9bd0e1d77bc24, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:29.730152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a3ec6-e215-4866-9f71-5284d5acc51e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:29.847971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 835/1667] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:29 2022] PUT /identity/v3/projects/e1e6c2f629c24254b61df09178ba2981/users/51ea75f1153a4076adc9bd0e1d77bc24/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:29.847971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091059ab-10e1-4864-b6f3-f4d06b8f0d1f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.847971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091059ab-10e1-4864-b6f3-f4d06b8f0d1f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.847971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091059ab-10e1-4864-b6f3-f4d06b8f0d1f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.847971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 836/1668] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 10:25:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:25:29.850826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25fbc-0da9-40ba-aaf4-235154b87631 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:29.851123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25fbc-0da9-40ba-aaf4-235154b87631 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:29.851524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25fbc-0da9-40ba-aaf4-235154b87631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:29.886819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866c9fb197894ca3b24cc32f9dbab86c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:29.910264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866c9fb197894ca3b24cc32f9dbab86c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:29.931863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-16b25fbc-0da9-40ba-aaf4-235154b87631 None None] MFA Rules not processed for user `51ea75f1153a4076adc9bd0e1d77bc24`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:29.933438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-16b25fbc-0da9-40ba-aaf4-235154b87631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:29.996249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866c9fb197894ca3b24cc32f9dbab86c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:30.015958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866c9fb197894ca3b24cc32f9dbab86c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:30.017705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f229adc8-d563-4fcf-8270-ce07a33bc784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866c9fb197894ca3b24cc32f9dbab86c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:30.033531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 833/1669] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:29 2022] DELETE /identity/v3/users/866c9fb197894ca3b24cc32f9dbab86c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:30.040954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a529e-54ec-4c76-aa11-163c01001d94 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:30.041265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a529e-54ec-4c76-aa11-163c01001d94 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:30.041701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a529e-54ec-4c76-aa11-163c01001d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:30.129143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-148a529e-54ec-4c76-aa11-163c01001d94 None None] MFA Rules not processed for user `757ad5baa909451d94dd1eced0407d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:30.136603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-148a529e-54ec-4c76-aa11-163c01001d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:30.136720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 837/1670] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:30.139530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b25fbc-0da9-40ba-aaf4-235154b87631 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:30.148597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-16b25fbc-0da9-40ba-aaf4-235154b87631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:30.223194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 834/1671] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:30.294316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b25fbc-0da9-40ba-aaf4-235154b87631 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:30.381744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a529e-54ec-4c76-aa11-163c01001d94 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:30.383409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-148a529e-54ec-4c76-aa11-163c01001d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:30.406927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569f4b-b23b-4938-a9eb-5f36368c96cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:30.407230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a529e-54ec-4c76-aa11-163c01001d94 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:30.408017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569f4b-b23b-4938-a9eb-5f36368c96cd admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:30.408569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569f4b-b23b-4938-a9eb-5f36368c96cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:30.409001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569f4b-b23b-4938-a9eb-5f36368c96cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:30.417834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569f4b-b23b-4938-a9eb-5f36368c96cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:30.417834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569f4b-b23b-4938-a9eb-5f36368c96cd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:30.421730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1048826-3ea0-41b7-af55-4a184f236ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:30.422373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1048826-3ea0-41b7-af55-4a184f236ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:30.422710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1048826-3ea0-41b7-af55-4a184f236ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:30.422990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1048826-3ea0-41b7-af55-4a184f236ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:30.445609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1048826-3ea0-41b7-af55-4a184f236ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:30.450644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1048826-3ea0-41b7-af55-4a184f236ca2 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:30.465640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:30.478050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 835/1672] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:25:30.533787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 838/1673] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:30 2022] POST /identity/v3/projects => generated 373 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:30.538527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1048826-3ea0-41b7-af55-4a184f236ca2 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:30.560404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1048826-3ea0-41b7-af55-4a184f236ca2 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:30.657896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:30.757959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072eac7-6e5b-4186-aeed-daa1f0da58ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:30.758850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072eac7-6e5b-4186-aeed-daa1f0da58ce admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:30.759236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072eac7-6e5b-4186-aeed-daa1f0da58ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:30.759771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072eac7-6e5b-4186-aeed-daa1f0da58ce admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:30.760594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072eac7-6e5b-4186-aeed-daa1f0da58ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:30.763356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072eac7-6e5b-4186-aeed-daa1f0da58ce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:30.883818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 836/1674] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:30 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:30.887710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569f4b-b23b-4938-a9eb-5f36368c96cd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:30.904609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569f4b-b23b-4938-a9eb-5f36368c96cd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:30.918488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e1457-6a83-450c-ac7b-8b13c4157193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:30.920130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e1457-6a83-450c-ac7b-8b13c4157193 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:30.923167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e1457-6a83-450c-ac7b-8b13c4157193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:30.923916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e1457-6a83-450c-ac7b-8b13c4157193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:30.924780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e1457-6a83-450c-ac7b-8b13c4157193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:30.926525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e1457-6a83-450c-ac7b-8b13c4157193 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:30.961919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 839/1675] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:30.966116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072eac7-6e5b-4186-aeed-daa1f0da58ce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:30.981850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072eac7-6e5b-4186-aeed-daa1f0da58ce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:30.994948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbb9d7-1a76-4dba-a87b-024f160855a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:30.996934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb9d7-1a76-4dba-a87b-024f160855a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:30.997799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb9d7-1a76-4dba-a87b-024f160855a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:30.998873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb9d7-1a76-4dba-a87b-024f160855a8 admin admin] PATH_INFO: `/v3/projects/37f8c4cefa2c4679b0bf36bd9e4cc8a6/users/6eb1cae738af4f1b8bcba29499a6947a/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:31.021642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbb9d7-1a76-4dba-a87b-024f160855a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f8c4cefa2c4679b0bf36bd9e4cc8a6, user_id=6eb1cae738af4f1b8bcba29499a6947a, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:31.026707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbb9d7-1a76-4dba-a87b-024f160855a8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:31.150217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 837/1676] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:30 2022] PUT /identity/v3/projects/37f8c4cefa2c4679b0bf36bd9e4cc8a6/users/6eb1cae738af4f1b8bcba29499a6947a/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:31.152355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e1457-6a83-450c-ac7b-8b13c4157193 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:31.179335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e1457-6a83-450c-ac7b-8b13c4157193 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:31.376181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bcb24-2c86-4042-9716-e131bbd56a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:31.377037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcb24-2c86-4042-9716-e131bbd56a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:31.377126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcb24-2c86-4042-9716-e131bbd56a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:31.377420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcb24-2c86-4042-9716-e131bbd56a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:31.384259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bcb24-2c86-4042-9716-e131bbd56a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:31.394216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bcb24-2c86-4042-9716-e131bbd56a4f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:31.415485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 840/1677] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:31.416204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbb9d7-1a76-4dba-a87b-024f160855a8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:31.429223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbb9d7-1a76-4dba-a87b-024f160855a8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:31.437073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:31.438225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:31.438662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:31.439383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] PATH_INFO: `/v3/projects/37f8c4cefa2c4679b0bf36bd9e4cc8a6/users/6eb1cae738af4f1b8bcba29499a6947a/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:31.447152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f8c4cefa2c4679b0bf36bd9e4cc8a6, user_id=6eb1cae738af4f1b8bcba29499a6947a, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:31.450318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:31.476280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 838/1678] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:31 2022] PUT /identity/v3/projects/37f8c4cefa2c4679b0bf36bd9e4cc8a6/users/6eb1cae738af4f1b8bcba29499a6947a/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:31.480253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6beb0-a8ff-4e5c-8dd6-62eb75c10517 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:31.482811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6beb0-a8ff-4e5c-8dd6-62eb75c10517 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:31.483339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6beb0-a8ff-4e5c-8dd6-62eb75c10517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:31.534055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8ff6beb0-a8ff-4e5c-8dd6-62eb75c10517 None None] MFA Rules not processed for user `6eb1cae738af4f1b8bcba29499a6947a`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:31.536494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8ff6beb0-a8ff-4e5c-8dd6-62eb75c10517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:31.737552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:31.839244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 841/1679] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:31.841688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:31.843714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:31.865689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6beb0-a8ff-4e5c-8dd6-62eb75c10517 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:31.868475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8ff6beb0-a8ff-4e5c-8dd6-62eb75c10517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:32.044167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124658f-5d28-4512-9911-77ac2db783e4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:32.045553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6beb0-a8ff-4e5c-8dd6-62eb75c10517 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:32.058683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbbec-d1d8-4dcd-aa0f-deadcb8a5f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:32.063268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbbec-d1d8-4dcd-aa0f-deadcb8a5f96 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:32.063791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbbec-d1d8-4dcd-aa0f-deadcb8a5f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:32.064216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbbec-d1d8-4dcd-aa0f-deadcb8a5f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:32.080187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:32.082674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:32.085112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:32.085753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] PATH_INFO: `/v3/projects/ef88e96a0f204934b793789c582534be` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:32.087259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdbbec-d1d8-4dcd-aa0f-deadcb8a5f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:32.088266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef88e96a0f204934b793789c582534be)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:32.091424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdbbec-d1d8-4dcd-aa0f-deadcb8a5f96 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:32.097184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:32.131320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:32.136613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 842/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:32.375807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef88e96a0f204934b793789c582534be', 'request_id': 'req-9473a42c-b5d4-4f87-bc14-983a8166a4d1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:32.471904 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef88e96a0f204934b793789c582534be', 'request_id': 'req-9473a42c-b5d4-4f87-bc14-983a8166a4d1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:32.484040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef88e96a0f204934b793789c582534be', 'request_id': 'req-9473a42c-b5d4-4f87-bc14-983a8166a4d1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:32.554455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] The token cache is being invalidate because project ef88e96a0f204934b793789c582534be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:32.554762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:32.556674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:32.584036 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 839/1681] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:31 2022] DELETE /identity/v3/projects/ef88e96a0f204934b793789c582534be => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:32.590219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9581-7606-4e77-8062-d4ff880edba9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:32.590825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9581-7606-4e77-8062-d4ff880edba9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:32.590905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9581-7606-4e77-8062-d4ff880edba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:32.646204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b39a9581-7606-4e77-8062-d4ff880edba9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:32.651084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b39a9581-7606-4e77-8062-d4ff880edba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:32.789868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:32.791313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:32.918995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 843/1682] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:32.929423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f0c6d-b127-4bda-97d4-9e34770c2d2c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:32.929423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f0c6d-b127-4bda-97d4-9e34770c2d2c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:32.929423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f0c6d-b127-4bda-97d4-9e34770c2d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:33.038674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-142f0c6d-b127-4bda-97d4-9e34770c2d2c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:33.047506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-142f0c6d-b127-4bda-97d4-9e34770c2d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:33.064058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a42c-b5d4-4f87-bc14-983a8166a4d1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:33.070508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:33.071110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:33.071390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:33.071666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] PATH_INFO: `/v3/projects/9a4e9277bbe44a3795a11bd06c1dcdf3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:33.072862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4e9277bbe44a3795a11bd06c1dcdf3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:33.081075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:33.090081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:33.103891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 844/1683] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:33.107633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f0c6d-b127-4bda-97d4-9e34770c2d2c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:33.112896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-142f0c6d-b127-4bda-97d4-9e34770c2d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:33.296115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4e9277bbe44a3795a11bd06c1dcdf3', 'request_id': 'req-3f72c9e4-3193-439c-b6c7-814281bacc74'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:33.324155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f0c6d-b127-4bda-97d4-9e34770c2d2c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:33.402101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4e9277bbe44a3795a11bd06c1dcdf3', 'request_id': 'req-3f72c9e4-3193-439c-b6c7-814281bacc74'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:33.413607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4e9277bbe44a3795a11bd06c1dcdf3', 'request_id': 'req-3f72c9e4-3193-439c-b6c7-814281bacc74'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:33.436708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] The token cache is being invalidate because project 9a4e9277bbe44a3795a11bd06c1dcdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:33.437622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:33.443067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:33.455542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 840/1684] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:32 2022] DELETE /identity/v3/projects/9a4e9277bbe44a3795a11bd06c1dcdf3 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:33.458644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:33.462190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:33.510378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52734e04-29b5-4b36-9f22-2c100dbc216e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:33.512863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734e04-29b5-4b36-9f22-2c100dbc216e service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:33.512991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734e04-29b5-4b36-9f22-2c100dbc216e service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:33.513256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52734e04-29b5-4b36-9f22-2c100dbc216e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:33.521202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-52734e04-29b5-4b36-9f22-2c100dbc216e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:33.532635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:33.549484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52734e04-29b5-4b36-9f22-2c100dbc216e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:33.551870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52734e04-29b5-4b36-9f22-2c100dbc216e service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:33.584584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 845/1685] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:33.588147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782343fe-d4ee-49d7-b7b5-6e80a05398c8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:33.590407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782343fe-d4ee-49d7-b7b5-6e80a05398c8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:33.590407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782343fe-d4ee-49d7-b7b5-6e80a05398c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:33.627224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72c9e4-3193-439c-b6c7-814281bacc74 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:33.632654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9808-46fd-4a22-95c6-114ba663808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:33.633293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9808-46fd-4a22-95c6-114ba663808c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:33.637873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9808-46fd-4a22-95c6-114ba663808c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:33.637873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9808-46fd-4a22-95c6-114ba663808c admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:33.637873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9808-46fd-4a22-95c6-114ba663808c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:33.637873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9808-46fd-4a22-95c6-114ba663808c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:33.638144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9808-46fd-4a22-95c6-114ba663808c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:33.664581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 841/1686] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:33.666748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53b3c-4356-43c6-9973-29b2f7b0f256 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:33.667960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53b3c-4356-43c6-9973-29b2f7b0f256 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:33.672250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a53b3c-4356-43c6-9973-29b2f7b0f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:33.678395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-782343fe-d4ee-49d7-b7b5-6e80a05398c8 None None] MFA Rules not processed for user `c6c7983040654f15ae92aea3511846de`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:33.681130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-782343fe-d4ee-49d7-b7b5-6e80a05398c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:33.696565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-50a53b3c-4356-43c6-9973-29b2f7b0f256 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:33.698785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-50a53b3c-4356-43c6-9973-29b2f7b0f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:33.708284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 842/1687] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:33.709776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a53b3c-4356-43c6-9973-29b2f7b0f256 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:33.742135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a53b3c-4356-43c6-9973-29b2f7b0f256 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:33.748164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:33.748970 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:33.756761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:33.757209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:33.758450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:33.761874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:33.828110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 846/1688] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:33.842296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78f08-f0e0-4ca8-8c80-830615f6d50d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:33.842780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78f08-f0e0-4ca8-8c80-830615f6d50d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:33.843668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78f08-f0e0-4ca8-8c80-830615f6d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:33.900811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 843/1689] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:33 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:33.909744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:33.915505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:33.919040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-15e78f08-f0e0-4ca8-8c80-830615f6d50d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:33.921893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-15e78f08-f0e0-4ca8-8c80-830615f6d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:34.058211 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:34.150981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29966c-7199-4915-8d34-05981515823b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:34.151398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 847/1690] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:34.152769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cbb72-721e-4c04-8ee6-b4e3a504d7f1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:34.153059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cbb72-721e-4c04-8ee6-b4e3a504d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:34.153327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cbb72-721e-4c04-8ee6-b4e3a504d7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:34.160529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:34.161182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:34.161484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:34.162190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] PATH_INFO: `/v3/users/51ea75f1153a4076adc9bd0e1d77bc24` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:34.181488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ea75f1153a4076adc9bd0e1d77bc24)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:34.184460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:34.242663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-589cbb72-721e-4c04-8ee6-b4e3a504d7f1 None None] MFA Rules not processed for user `c6c7983040654f15ae92aea3511846de`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:34.247492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-589cbb72-721e-4c04-8ee6-b4e3a504d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:34.368157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 848/1691] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:34.369020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cbb72-721e-4c04-8ee6-b4e3a504d7f1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:34.388974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cbb72-721e-4c04-8ee6-b4e3a504d7f1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:34.403615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df75cc0-baed-46c4-9c00-54d764156b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:34.404668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df75cc0-baed-46c4-9c00-54d764156b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:34.405057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df75cc0-baed-46c4-9c00-54d764156b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:34.405433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df75cc0-baed-46c4-9c00-54d764156b02 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:34.406233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df75cc0-baed-46c4-9c00-54d764156b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:34.411208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df75cc0-baed-46c4-9c00-54d764156b02 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:34.444354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ea75f1153a4076adc9bd0e1d77bc24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:34.459167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ea75f1153a4076adc9bd0e1d77bc24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:34.539920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ea75f1153a4076adc9bd0e1d77bc24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:34.548421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 849/1692] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:34 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:34.549566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df75cc0-baed-46c4-9c00-54d764156b02 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:34.562398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df75cc0-baed-46c4-9c00-54d764156b02 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:34.563575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ea75f1153a4076adc9bd0e1d77bc24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:34.564980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ea75f1153a4076adc9bd0e1d77bc24'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:34.570693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:34.570693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:34.571060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:34.571418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:34.572333 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:34.572772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:34.574907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:34.584447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 844/1693] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:33 2022] DELETE /identity/v3/users/51ea75f1153a4076adc9bd0e1d77bc24 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:34.584447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:34.587747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:34.594221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 850/1694] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:34.594221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:34.594221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:34.624199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f3a16-4102-4f7a-9aab-7eaf8b9a3908 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:34.745271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663e88b-085e-47ba-b731-3b6bcfd6d3d1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:34.762624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:34.770327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:34.770996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:34.771280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:34.778979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:34.790190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:34.858379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11165617-c670-498e-b91c-58184b6393e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:34.858998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165617-c670-498e-b91c-58184b6393e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:34.866841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165617-c670-498e-b91c-58184b6393e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:34.866841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11165617-c670-498e-b91c-58184b6393e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:34.866841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11165617-c670-498e-b91c-58184b6393e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:34.866841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11165617-c670-498e-b91c-58184b6393e1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:34.896197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 851/1695] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:34.912743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25702d-ae02-4c79-9fb8-ae65a4f06d9d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:34.913078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25702d-ae02-4c79-9fb8-ae65a4f06d9d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:34.913433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25702d-ae02-4c79-9fb8-ae65a4f06d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:34.966611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:34.967706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ec25702d-ae02-4c79-9fb8-ae65a4f06d9d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:34.968458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:34.977360 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ec25702d-ae02-4c79-9fb8-ae65a4f06d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:35.002961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 845/1696] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:35.004155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:35.005881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 852/1697] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:35.007447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25702d-ae02-4c79-9fb8-ae65a4f06d9d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:35.010305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:35.023710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:35.029020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5fd1f-cf96-4037-a62a-59ca03cf64d2 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:35.029464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25702d-ae02-4c79-9fb8-ae65a4f06d9d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:35.039950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:35.041527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:35.042148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:35.043095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:35.044013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:35.046678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:35.055974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fa50d-1377-4e1d-ad03-7db50403b8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:35.056634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fa50d-1377-4e1d-ad03-7db50403b8fd admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:35.056914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fa50d-1377-4e1d-ad03-7db50403b8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:35.057203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fa50d-1377-4e1d-ad03-7db50403b8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:35.063698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fa50d-1377-4e1d-ad03-7db50403b8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:35.063698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fa50d-1377-4e1d-ad03-7db50403b8fd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:35.091417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 853/1698] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:35.091417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1f80-7cc8-4842-945e-b08942f9d4fc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:35.091417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1f80-7cc8-4842-945e-b08942f9d4fc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:35.091417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f1f80-7cc8-4842-945e-b08942f9d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:35.187613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b22f1f80-7cc8-4842-945e-b08942f9d4fc None None] MFA Rules not processed for user `e0f0bf68631642c197600f557e999adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:35.191958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b22f1f80-7cc8-4842-945e-b08942f9d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:35.201774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 846/1699] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:35 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:35.202662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:35.207113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:35.315872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75cf6c-f1e9-4fe4-9532-978f7d3ac835 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:35.340621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f2d43-ef2d-4fa5-b382-30c51bbac3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:35.340621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f2d43-ef2d-4fa5-b382-30c51bbac3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:35.340621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f2d43-ef2d-4fa5-b382-30c51bbac3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:35.340621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f2d43-ef2d-4fa5-b382-30c51bbac3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:35.387565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 854/1700] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:35.387565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f1f80-7cc8-4842-945e-b08942f9d4fc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:35.397824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f1f80-7cc8-4842-945e-b08942f9d4fc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:35.447741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f2d43-ef2d-4fa5-b382-30c51bbac3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:35.453684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f2d43-ef2d-4fa5-b382-30c51bbac3f3 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:35.483184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 847/1701] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:35.484198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f2d43-ef2d-4fa5-b382-30c51bbac3f3 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:35.507105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f2d43-ef2d-4fa5-b382-30c51bbac3f3 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:35.517659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c3519-6e4a-492c-9b0b-d377c0da793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:35.518637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3519-6e4a-492c-9b0b-d377c0da793b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:35.519517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3519-6e4a-492c-9b0b-d377c0da793b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:35.519994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c3519-6e4a-492c-9b0b-d377c0da793b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:35.523259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c3519-6e4a-492c-9b0b-d377c0da793b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:35.526999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c3519-6e4a-492c-9b0b-d377c0da793b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:35.564049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:35.567451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:35.567451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:35.567451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] PATH_INFO: `/v3/projects/2a892199728048b6b608a988dc288447/users/cc2b75d4a24243169712cc3177c1d87a/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:35.596766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a892199728048b6b608a988dc288447, user_id=cc2b75d4a24243169712cc3177c1d87a, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:35.598781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:35.628722 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 848/1702] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:35 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:35.630933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c211-c4a5-4442-af6e-e466ca9cfba3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:35.631230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c211-c4a5-4442-af6e-e466ca9cfba3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:35.631527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c211-c4a5-4442-af6e-e466ca9cfba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:35.674110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-aa88c211-c4a5-4442-af6e-e466ca9cfba3 None None] MFA Rules not processed for user `9e755fa1e0ec4820a476b9807dfc3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:35.683066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 855/1703] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:35 2022] PUT /identity/v3/projects/2a892199728048b6b608a988dc288447/users/cc2b75d4a24243169712cc3177c1d87a/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:35.695939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:35.697390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aa88c211-c4a5-4442-af6e-e466ca9cfba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:35.700622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:35.782136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:35.878186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:35.879382 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 849/1704] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:35.879958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88c211-c4a5-4442-af6e-e466ca9cfba3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:35.905754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de1a29-fe2f-4e7c-b9a2-6053ba225b6d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:35.947827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145cc5-c61c-4c25-bb4c-c21ae08bfbb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:35.949525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145cc5-c61c-4c25-bb4c-c21ae08bfbb3 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:35.950178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145cc5-c61c-4c25-bb4c-c21ae08bfbb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:35.954502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145cc5-c61c-4c25-bb4c-c21ae08bfbb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.112902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88c211-c4a5-4442-af6e-e466ca9cfba3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:36.125404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84145cc5-c61c-4c25-bb4c-c21ae08bfbb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:36.127172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84145cc5-c61c-4c25-bb4c-c21ae08bfbb3 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:36.145177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:36.151417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69554-a60c-4822-9a1d-d69f133b0a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:36.155222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69554-a60c-4822-9a1d-d69f133b0a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:36.155222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69554-a60c-4822-9a1d-d69f133b0a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:36.155222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69554-a60c-4822-9a1d-d69f133b0a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.155222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69554-a60c-4822-9a1d-d69f133b0a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:36.161704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 856/1705] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:36.163459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c28f44-a1cc-47a8-a7e4-4c7d1e39535b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:36.164446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c28f44-a1cc-47a8-a7e4-4c7d1e39535b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:36.164801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c28f44-a1cc-47a8-a7e4-4c7d1e39535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.170341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69554-a60c-4822-9a1d-d69f133b0a6c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:36.216610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 850/1706] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:36.218672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeec209-a591-4826-83d8-5635029d0164 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:36.219110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeec209-a591-4826-83d8-5635029d0164 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:36.222203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeec209-a591-4826-83d8-5635029d0164 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.225535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 851/1707] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 28 10:25:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:25:36.226552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeec209-a591-4826-83d8-5635029d0164 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:36.256883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeec209-a591-4826-83d8-5635029d0164 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:36.265881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ce190-269d-4591-94bf-31d6a3c28852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:36.267496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ce190-269d-4591-94bf-31d6a3c28852 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:36.267793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ce190-269d-4591-94bf-31d6a3c28852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:36.268074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ce190-269d-4591-94bf-31d6a3c28852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.269101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ce190-269d-4591-94bf-31d6a3c28852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:36.270993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ce190-269d-4591-94bf-31d6a3c28852 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:36.274750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-19c28f44-a1cc-47a8-a7e4-4c7d1e39535b None None] MFA Rules not processed for user `cc2b75d4a24243169712cc3177c1d87a`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:36.282297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-19c28f44-a1cc-47a8-a7e4-4c7d1e39535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:36.293277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 852/1708] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:36.293277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcad9-4946-4935-a056-607120fc05b5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:36.293277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcad9-4946-4935-a056-607120fc05b5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:36.293277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcad9-4946-4935-a056-607120fc05b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.350832 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-685dcad9-4946-4935-a056-607120fc05b5 None None] MFA Rules not processed for user `757ad5baa909451d94dd1eced0407d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:36.352807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-685dcad9-4946-4935-a056-607120fc05b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:36.451348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 857/1709] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:36.456341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c28f44-a1cc-47a8-a7e4-4c7d1e39535b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:36.474690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c28f44-a1cc-47a8-a7e4-4c7d1e39535b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:36.486271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156622df-ccac-4fa1-b24d-f98f66524523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:36.488108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156622df-ccac-4fa1-b24d-f98f66524523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:36.488108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156622df-ccac-4fa1-b24d-f98f66524523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:36.488108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156622df-ccac-4fa1-b24d-f98f66524523 admin admin] PATH_INFO: `/v3/projects/2fc35e593af34d00b980e25920d82fb3/users/b4d34a4e54d740f5a5ca318614c03a61/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.525572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 853/1710] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:25:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:36.535655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156622df-ccac-4fa1-b24d-f98f66524523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc35e593af34d00b980e25920d82fb3, user_id=b4d34a4e54d740f5a5ca318614c03a61, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:36.539653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156622df-ccac-4fa1-b24d-f98f66524523 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:36.644002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 858/1711] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:36 2022] PUT /identity/v3/projects/2fc35e593af34d00b980e25920d82fb3/users/b4d34a4e54d740f5a5ca318614c03a61/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:36.655247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9d42-bb79-4e4f-ab9d-da8eb90c05d9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:36.655606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9d42-bb79-4e4f-ab9d-da8eb90c05d9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:36.655889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9d42-bb79-4e4f-ab9d-da8eb90c05d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.701322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156622df-ccac-4fa1-b24d-f98f66524523 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:36.747571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-52ba9d42-bb79-4e4f-ab9d-da8eb90c05d9 None None] MFA Rules not processed for user `b4d34a4e54d740f5a5ca318614c03a61`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:36.750656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-52ba9d42-bb79-4e4f-ab9d-da8eb90c05d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:36.778872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156622df-ccac-4fa1-b24d-f98f66524523 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:36.784226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:36.788127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:36.788127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:36.788127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:36.794940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:36.796646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:36.828763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 859/1712] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:36.831187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:36.838523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:36.888143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:36.962540 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:36.979117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 854/1713] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:36.980373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9d42-bb79-4e4f-ab9d-da8eb90c05d9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:37.078792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5588fd-7e48-49b6-92ab-5835322e9663 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:37.092845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:37.093509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:37.093796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:37.094132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] PATH_INFO: `/v3/projects/e1e6c2f629c24254b61df09178ba2981` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:37.098123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e6c2f629c24254b61df09178ba2981)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:37.102753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:37.178459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9d42-bb79-4e4f-ab9d-da8eb90c05d9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:37.200977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bbfe0-47c1-4681-a821-e58598abf8fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:37.201652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbfe0-47c1-4681-a821-e58598abf8fb service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:37.202002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbfe0-47c1-4681-a821-e58598abf8fb service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:37.207383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bbfe0-47c1-4681-a821-e58598abf8fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:37.318416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e6c2f629c24254b61df09178ba2981', 'request_id': 'req-0d3aa4d6-680b-4d45-beb9-e80863700b37'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:37.336083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e6c2f629c24254b61df09178ba2981', 'request_id': 'req-0d3aa4d6-680b-4d45-beb9-e80863700b37'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:37.355347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e6c2f629c24254b61df09178ba2981', 'request_id': 'req-0d3aa4d6-680b-4d45-beb9-e80863700b37'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:37.361324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bbfe0-47c1-4681-a821-e58598abf8fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:37.362980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bbfe0-47c1-4681-a821-e58598abf8fb service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:37.378886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 855/1714] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:37.378886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bbfe0-47c1-4681-a821-e58598abf8fb service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:37.389367 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bbfe0-47c1-4681-a821-e58598abf8fb service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:37.464992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] The token cache is being invalidate because project e1e6c2f629c24254b61df09178ba2981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:37.464992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:37.464992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:37.466435 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 860/1715] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:36 2022] DELETE /identity/v3/projects/e1e6c2f629c24254b61df09178ba2981 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:37.470240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:37.472621 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:37.497408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:37.498055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:37.498313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:37.498593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:37.499322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:37.505684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:37.609501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aa4d6-680b-4d45-beb9-e80863700b37 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:37.617010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:37.618446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:37.618792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:37.619129 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] PATH_INFO: `/v3/users/6eb1cae738af4f1b8bcba29499a6947a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:37.621220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb1cae738af4f1b8bcba29499a6947a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:37.624672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:37.699478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 856/1716] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:37 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:37.700710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:37.704305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:37.747797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:37.850452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a3ec1-be08-4bc6-9c67-3c360bcee301 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:37.857780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:37.859564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:37.860090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:37.860602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:37.863336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:37.917165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:37.924658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb1cae738af4f1b8bcba29499a6947a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:37.946299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb1cae738af4f1b8bcba29499a6947a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:37.986009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb1cae738af4f1b8bcba29499a6947a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:38.012085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:38.024524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:38.028041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:38.058649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 857/1717] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:38.059766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:38.075542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:38.093448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb1cae738af4f1b8bcba29499a6947a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:38.094475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-958a6941-8550-4319-91ff-592f192afee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb1cae738af4f1b8bcba29499a6947a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:38.105175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 861/1718] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:37 2022] DELETE /identity/v3/users/6eb1cae738af4f1b8bcba29499a6947a => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:38.107284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d9fb-1234-4c54-95a2-56ce9bbb80e5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:38.111939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d9fb-1234-4c54-95a2-56ce9bbb80e5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:38.112243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8d9fb-1234-4c54-95a2-56ce9bbb80e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:38.197089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-88e8d9fb-1234-4c54-95a2-56ce9bbb80e5 None None] MFA Rules not processed for user `c6c7983040654f15ae92aea3511846de`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:38.203420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88e8d9fb-1234-4c54-95a2-56ce9bbb80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:38.283964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe5d9b-313e-4739-aa56-8653d2369ef8 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:38.437991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:38.440973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:38.441497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:38.441977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:38.443688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:38.450630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:38.491103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 862/1719] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:38.581775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d9fb-1234-4c54-95a2-56ce9bbb80e5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:38.584092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88e8d9fb-1234-4c54-95a2-56ce9bbb80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:38.603993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 858/1720] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:38 2022] POST /identity/v3/users => generated 289 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:38.608741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:38.617171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:38.618350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8d9fb-1234-4c54-95a2-56ce9bbb80e5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:38.638093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:38.638837 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:38.640513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:38.640795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] PATH_INFO: `/v3/users/cc2b75d4a24243169712cc3177c1d87a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:38.649211 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2b75d4a24243169712cc3177c1d87a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:38.651437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:38.669455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932abd-3bca-4ec7-9b51-f7e160d0de70 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:38.685167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36406fb5-bb3c-4df2-8931-30ddb532e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:38.685819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36406fb5-bb3c-4df2-8931-30ddb532e5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:38.686318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36406fb5-bb3c-4df2-8931-30ddb532e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:38.692233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36406fb5-bb3c-4df2-8931-30ddb532e5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:38.692233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36406fb5-bb3c-4df2-8931-30ddb532e5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:38.692233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36406fb5-bb3c-4df2-8931-30ddb532e5b9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:38.729415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 859/1721] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:38.741771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36406fb5-bb3c-4df2-8931-30ddb532e5b9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:38.775061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36406fb5-bb3c-4df2-8931-30ddb532e5b9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:38.784355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec01a90-5e45-44d6-9ef5-ba79d6617df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:38.785010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01a90-5e45-44d6-9ef5-ba79d6617df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:38.785281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01a90-5e45-44d6-9ef5-ba79d6617df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:38.785564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec01a90-5e45-44d6-9ef5-ba79d6617df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:38.786276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec01a90-5e45-44d6-9ef5-ba79d6617df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:38.788904 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec01a90-5e45-44d6-9ef5-ba79d6617df2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:38.852921 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 860/1722] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:38.856663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec01a90-5e45-44d6-9ef5-ba79d6617df2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:38.870540 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec01a90-5e45-44d6-9ef5-ba79d6617df2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:38.900452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbee25b-b67a-42f4-baf9-0f27929cccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:38.901010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbee25b-b67a-42f4-baf9-0f27929cccfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:38.901418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbee25b-b67a-42f4-baf9-0f27929cccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:38.901710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbee25b-b67a-42f4-baf9-0f27929cccfe admin admin] PATH_INFO: `/v3/projects/a73ced7e553749a49720274c6dc744cc/users/c1eda6a7807643d082055fe559ae6feb/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:38.924275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2b75d4a24243169712cc3177c1d87a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:38.937974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbee25b-b67a-42f4-baf9-0f27929cccfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73ced7e553749a49720274c6dc744cc, user_id=c1eda6a7807643d082055fe559ae6feb, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:38.940967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbee25b-b67a-42f4-baf9-0f27929cccfe admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:38.954197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2b75d4a24243169712cc3177c1d87a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:38.985758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2b75d4a24243169712cc3177c1d87a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:39.070276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 861/1723] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:38 2022] PUT /identity/v3/projects/a73ced7e553749a49720274c6dc744cc/users/c1eda6a7807643d082055fe559ae6feb/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:39.072630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe7287-3010-4d7d-843e-a33fcd17e360 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:39.073425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe7287-3010-4d7d-843e-a33fcd17e360 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:39.074994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe7287-3010-4d7d-843e-a33fcd17e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:39.090857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2b75d4a24243169712cc3177c1d87a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:39.092686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-164a41de-0120-4d52-b914-4db45d8b0bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2b75d4a24243169712cc3177c1d87a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:39.105348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 863/1724] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:38 2022] DELETE /identity/v3/users/cc2b75d4a24243169712cc3177c1d87a => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:39.110611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e0192-cd78-4289-adb0-f710614fd50f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:39.113402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e0192-cd78-4289-adb0-f710614fd50f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:39.115530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e0192-cd78-4289-adb0-f710614fd50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:39.194429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:39.217843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b97e0192-cd78-4289-adb0-f710614fd50f None None] MFA Rules not processed for user `c1eda6a7807643d082055fe559ae6feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:39.217843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b97e0192-cd78-4289-adb0-f710614fd50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:39.243819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-31fe7287-3010-4d7d-843e-a33fcd17e360 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:39.245169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-31fe7287-3010-4d7d-843e-a33fcd17e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:39.290239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:39.423556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 862/1725] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:25:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:39.426166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39f15-b334-4f45-98f4-a3b57a4feef9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:39.428153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39f15-b334-4f45-98f4-a3b57a4feef9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:39.428638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39f15-b334-4f45-98f4-a3b57a4feef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:39.477749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c7d39f15-b334-4f45-98f4-a3b57a4feef9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:39.482132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c7d39f15-b334-4f45-98f4-a3b57a4feef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:39.512634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 864/1726] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:39.516697 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e0192-cd78-4289-adb0-f710614fd50f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:39.517532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b97e0192-cd78-4289-adb0-f710614fd50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:39.699934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 863/1727] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:39.701456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39f15-b334-4f45-98f4-a3b57a4feef9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:39.705978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c7d39f15-b334-4f45-98f4-a3b57a4feef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:39.740902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39f15-b334-4f45-98f4-a3b57a4feef9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:39.753698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:39.753943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:39.754177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:39.754475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:39.755307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:39.760334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:39.825389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e0192-cd78-4289-adb0-f710614fd50f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:39.841359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:39.842290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:39.842743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:39.843185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] PATH_INFO: `/v3/projects/37f8c4cefa2c4679b0bf36bd9e4cc8a6` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:39.848557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f8c4cefa2c4679b0bf36bd9e4cc8a6)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:39.852702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:39.908140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 864/1728] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:39 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:39.908140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:39.917179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:40.057672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f8c4cefa2c4679b0bf36bd9e4cc8a6', 'request_id': 'req-1336f4fd-d978-4ca1-9e9f-7b470429c874'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:40.078938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f8c4cefa2c4679b0bf36bd9e4cc8a6', 'request_id': 'req-1336f4fd-d978-4ca1-9e9f-7b470429c874'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:40.096968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f8c4cefa2c4679b0bf36bd9e4cc8a6', 'request_id': 'req-1336f4fd-d978-4ca1-9e9f-7b470429c874'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:40.098253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2f33d-db3f-485c-93ac-ce57c4df3ba6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:40.170594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:40.233367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] The token cache is being invalidate because project 37f8c4cefa2c4679b0bf36bd9e4cc8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:40.233860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:40.238396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:40.241599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 865/1729] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:39 2022] DELETE /identity/v3/projects/37f8c4cefa2c4679b0bf36bd9e4cc8a6 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:40.242718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:40.248253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:40.261255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:40.261899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:40.262180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:40.262451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:40.265976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:40.413428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:40.414908 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:40.436181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 865/1730] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:40.436806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:40.441156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:40.484269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336f4fd-d978-4ca1-9e9f-7b470429c874 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:40.557031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491dfcd-faa2-4f63-883c-83d5f44f93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:40.570158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491dfcd-faa2-4f63-883c-83d5f44f93bb admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:40.572868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491dfcd-faa2-4f63-883c-83d5f44f93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:40.575901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491dfcd-faa2-4f63-883c-83d5f44f93bb admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:40.577097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491dfcd-faa2-4f63-883c-83d5f44f93bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:40.612643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491dfcd-faa2-4f63-883c-83d5f44f93bb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:40.622474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:40.753890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 866/1731] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:40 2022] POST /identity/v3/users => generated 296 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:40.753890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df2eb-dc48-419c-9bc5-9e97e0b99b24 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:40.753890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df2eb-dc48-419c-9bc5-9e97e0b99b24 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:40.753890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4df2eb-dc48-419c-9bc5-9e97e0b99b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:40.815248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f928d-d687-4696-a1c4-8c5505b2e050 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:40.826994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8e4df2eb-dc48-419c-9bc5-9e97e0b99b24 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:40.828275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8e4df2eb-dc48-419c-9bc5-9e97e0b99b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:40.855350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:40.855350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:40.855607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:40.855756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:40.864167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:40.882971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 867/1732] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:40.897220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4df2eb-dc48-419c-9bc5-9e97e0b99b24 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:40.934425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4df2eb-dc48-419c-9bc5-9e97e0b99b24 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:40.958220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4832bf-19c5-401c-9b60-6710d7b0e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:40.959951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4832bf-19c5-401c-9b60-6710d7b0e475 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:40.961645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4832bf-19c5-401c-9b60-6710d7b0e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:40.962121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4832bf-19c5-401c-9b60-6710d7b0e475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:40.963391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4832bf-19c5-401c-9b60-6710d7b0e475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:40.971071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4832bf-19c5-401c-9b60-6710d7b0e475 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:41.012611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 868/1733] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:41.015802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfaf6-ee94-4576-b7b6-e1ca40497595 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:41.024884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfaf6-ee94-4576-b7b6-e1ca40497595 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:41.025148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dfaf6-ee94-4576-b7b6-e1ca40497595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:41.129947 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9c0dfaf6-ee94-4576-b7b6-e1ca40497595 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:41.135754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9c0dfaf6-ee94-4576-b7b6-e1ca40497595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:41.151344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:41.156877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:41.165256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:41.180997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 869/1734] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:41.181850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dfaf6-ee94-4576-b7b6-e1ca40497595 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:41.207706 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 866/1735] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:25:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:25:41.209149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:41.232745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dfaf6-ee94-4576-b7b6-e1ca40497595 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:41.254699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586a73-1dea-4fdf-a928-925ca99dbaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:41.257087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586a73-1dea-4fdf-a928-925ca99dbaa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:41.257331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586a73-1dea-4fdf-a928-925ca99dbaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:41.257596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1586a73-1dea-4fdf-a928-925ca99dbaa2 admin admin] PATH_INFO: `/v3/projects/a5b4921c58134c9fa3cbb1b8b539712e/users/c78424f27c0e412aadd12179d80174dd/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:41.261693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2d6cd-74ca-485a-924c-5d01dff005fe service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:41.289051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:41.292253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:41.292574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:41.297286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:41.298111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:41.298378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:41.309020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:41.329229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1586a73-1dea-4fdf-a928-925ca99dbaa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b4921c58134c9fa3cbb1b8b539712e, user_id=c78424f27c0e412aadd12179d80174dd, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:41.337564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1586a73-1dea-4fdf-a928-925ca99dbaa2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:41.355112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 867/1736] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:41.361581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:41.376463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401f000-822d-4594-90ba-280d460c0e55 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:41.387488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42feca-552e-41a4-9ecb-0a5a738dc73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:41.389108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42feca-552e-41a4-9ecb-0a5a738dc73e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:41.389697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42feca-552e-41a4-9ecb-0a5a738dc73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:41.390111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42feca-552e-41a4-9ecb-0a5a738dc73e admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:41.390874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42feca-552e-41a4-9ecb-0a5a738dc73e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:41.393538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42feca-552e-41a4-9ecb-0a5a738dc73e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:41.457427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 870/1737] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:41 2022] PUT /identity/v3/projects/a5b4921c58134c9fa3cbb1b8b539712e/users/c78424f27c0e412aadd12179d80174dd/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:41.461576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586a73-1dea-4fdf-a928-925ca99dbaa2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:41.553557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 868/1738] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:41 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:25:41.555784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42feca-552e-41a4-9ecb-0a5a738dc73e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:41.744591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1586a73-1dea-4fdf-a928-925ca99dbaa2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:41.756281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6318b1b-96fc-45db-b9df-84b66dff1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:41.757523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6318b1b-96fc-45db-b9df-84b66dff1de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:41.758085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6318b1b-96fc-45db-b9df-84b66dff1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:41.758573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6318b1b-96fc-45db-b9df-84b66dff1de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:41.759466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6318b1b-96fc-45db-b9df-84b66dff1de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:41.761554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6318b1b-96fc-45db-b9df-84b66dff1de3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:41.766022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42feca-552e-41a4-9ecb-0a5a738dc73e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:41.774365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8911b4-4661-4a5b-a894-332837b29806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:41.775090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8911b4-4661-4a5b-a894-332837b29806 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:41.775440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8911b4-4661-4a5b-a894-332837b29806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:41.775728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8911b4-4661-4a5b-a894-332837b29806 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:41.776429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8911b4-4661-4a5b-a894-332837b29806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:41.779081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8911b4-4661-4a5b-a894-332837b29806 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:41.792828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 871/1739] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:41.795879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6318b1b-96fc-45db-b9df-84b66dff1de3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:41.822491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6318b1b-96fc-45db-b9df-84b66dff1de3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:41.838073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f112d-58cf-4e97-b397-c29bf0cb26b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:41.839761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f112d-58cf-4e97-b397-c29bf0cb26b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:41.841175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f112d-58cf-4e97-b397-c29bf0cb26b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:41.841693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f112d-58cf-4e97-b397-c29bf0cb26b6 admin admin] PATH_INFO: `/v3/projects/a5b4921c58134c9fa3cbb1b8b539712e/users/c78424f27c0e412aadd12179d80174dd/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:41.844728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f112d-58cf-4e97-b397-c29bf0cb26b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b4921c58134c9fa3cbb1b8b539712e, user_id=c78424f27c0e412aadd12179d80174dd, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:41.850922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f112d-58cf-4e97-b397-c29bf0cb26b6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:41.882461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 872/1740] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:41 2022] PUT /identity/v3/projects/a5b4921c58134c9fa3cbb1b8b539712e/users/c78424f27c0e412aadd12179d80174dd/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:41.884527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503d09-8419-40e3-83e7-a8eec41fa091 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:41.885273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503d09-8419-40e3-83e7-a8eec41fa091 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:41.902842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3503d09-8419-40e3-83e7-a8eec41fa091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:41.947485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 869/1741] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:41 2022] POST /identity/v3/users => generated 294 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:41.951466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8911b4-4661-4a5b-a894-332837b29806 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:41.986773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8911b4-4661-4a5b-a894-332837b29806 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:42.002205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b3503d09-8419-40e3-83e7-a8eec41fa091 None None] MFA Rules not processed for user `c78424f27c0e412aadd12179d80174dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:42.003518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b3503d09-8419-40e3-83e7-a8eec41fa091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:42.208553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3a1c7-a760-4597-a87b-29d934ab75f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:42.209678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a1c7-a760-4597-a87b-29d934ab75f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:42.210135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a1c7-a760-4597-a87b-29d934ab75f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:42.210580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3a1c7-a760-4597-a87b-29d934ab75f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:42.211446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3a1c7-a760-4597-a87b-29d934ab75f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:42.213308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3a1c7-a760-4597-a87b-29d934ab75f6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:42.249240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 870/1742] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:42.250466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3a1c7-a760-4597-a87b-29d934ab75f6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:42.252515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 873/1743] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:42.261095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503d09-8419-40e3-83e7-a8eec41fa091 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:42.264084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b3503d09-8419-40e3-83e7-a8eec41fa091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:42.282478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3a1c7-a760-4597-a87b-29d934ab75f6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:42.295246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df36487-1c9b-4bb6-ba4a-6539badfa925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:42.296022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df36487-1c9b-4bb6-ba4a-6539badfa925 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:42.296448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df36487-1c9b-4bb6-ba4a-6539badfa925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:42.296817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df36487-1c9b-4bb6-ba4a-6539badfa925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:42.297610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df36487-1c9b-4bb6-ba4a-6539badfa925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:42.299329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df36487-1c9b-4bb6-ba4a-6539badfa925 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:42.306034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:42.325870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 871/1744] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:42.326953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df36487-1c9b-4bb6-ba4a-6539badfa925 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:42.360396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df36487-1c9b-4bb6-ba4a-6539badfa925 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:42.390265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26404e39-0308-4431-9230-6238ad5f9728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:42.390947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26404e39-0308-4431-9230-6238ad5f9728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:42.391227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26404e39-0308-4431-9230-6238ad5f9728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:42.391500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26404e39-0308-4431-9230-6238ad5f9728 admin admin] PATH_INFO: `/v3/projects/61c93d72dfc746efa5c9906a82b3d892/users/8db4ef8d9cf04eb6a2de41eaca302803/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:42.446393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26404e39-0308-4431-9230-6238ad5f9728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c93d72dfc746efa5c9906a82b3d892, user_id=8db4ef8d9cf04eb6a2de41eaca302803, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:42.449297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26404e39-0308-4431-9230-6238ad5f9728 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:42.471641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3503d09-8419-40e3-83e7-a8eec41fa091 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:42.483658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204d3e7-db8d-428b-9d97-1baf290578bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:42.485428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d3e7-db8d-428b-9d97-1baf290578bf service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:42.485894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d3e7-db8d-428b-9d97-1baf290578bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:42.486341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204d3e7-db8d-428b-9d97-1baf290578bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:42.500922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204d3e7-db8d-428b-9d97-1baf290578bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:42.504219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204d3e7-db8d-428b-9d97-1baf290578bf service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:42.521848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 874/1745] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:42.589919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 872/1746] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:42 2022] PUT /identity/v3/projects/61c93d72dfc746efa5c9906a82b3d892/users/8db4ef8d9cf04eb6a2de41eaca302803/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:42.597241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9bb0-e35a-46b6-a386-11d86de6343f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:42.597241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9bb0-e35a-46b6-a386-11d86de6343f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:42.597241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9bb0-e35a-46b6-a386-11d86de6343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:42.675472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c38f9bb0-e35a-46b6-a386-11d86de6343f None None] MFA Rules not processed for user `8db4ef8d9cf04eb6a2de41eaca302803`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:42.676257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c38f9bb0-e35a-46b6-a386-11d86de6343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:42.878735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 875/1747] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:42.888519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26404e39-0308-4431-9230-6238ad5f9728 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:42.919999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f9bb0-e35a-46b6-a386-11d86de6343f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:42.919999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c38f9bb0-e35a-46b6-a386-11d86de6343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:42.920183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:43.096465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f9bb0-e35a-46b6-a386-11d86de6343f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:43.101343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26404e39-0308-4431-9230-6238ad5f9728 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:43.106039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:43.106709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:43.107009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:43.107311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:43.111694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:43.125033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:43.134705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:43.134705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:43.134705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:43.134705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:43.138527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:43.237708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:43.243494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:43.259210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 876/1748] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:43.346060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 873/1749] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:42 2022] POST /identity/v3/projects => generated 385 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:43.350722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:43.365873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:43.369944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:43.373290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf113c-c018-4ad9-b4fa-2119facac3a6 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:43.423929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:43.586578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729569a-dda6-4f22-b5c4-5bfa1d1741d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:43.587239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729569a-dda6-4f22-b5c4-5bfa1d1741d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:43.588732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729569a-dda6-4f22-b5c4-5bfa1d1741d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:43.589029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729569a-dda6-4f22-b5c4-5bfa1d1741d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:43.589974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729569a-dda6-4f22-b5c4-5bfa1d1741d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:43.595486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbd8ce-5603-452c-bd0e-60de81197d25 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:43.597257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729569a-dda6-4f22-b5c4-5bfa1d1741d8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:43.607337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:43.608033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:43.608345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:43.610445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] PATH_INFO: `/v3/projects/2a892199728048b6b608a988dc288447` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:43.612173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a892199728048b6b608a988dc288447)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:43.619674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:43.745106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 877/1750] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:43 2022] POST /identity/v3/users => generated 299 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:43.746634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3141d7-94ed-4fa2-b1d2-96f78cfc612e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:43.750632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3141d7-94ed-4fa2-b1d2-96f78cfc612e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:43.750935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3141d7-94ed-4fa2-b1d2-96f78cfc612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:43.837670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a892199728048b6b608a988dc288447', 'request_id': 'req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:43.878237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0f3141d7-94ed-4fa2-b1d2-96f78cfc612e None None] MFA Rules not processed for user `757ad5baa909451d94dd1eced0407d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:43.884148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0f3141d7-94ed-4fa2-b1d2-96f78cfc612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:43.945153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a892199728048b6b608a988dc288447', 'request_id': 'req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:43.953076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a892199728048b6b608a988dc288447', 'request_id': 'req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:43.986532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 878/1751] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Aug 28 10:25:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:43.988960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3141d7-94ed-4fa2-b1d2-96f78cfc612e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:43.993456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] The token cache is being invalidate because project 2a892199728048b6b608a988dc288447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:43.994036 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:43.997289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2f0798cd-a8a6-4f77-a4b7-7cccc1c2572f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:44.000117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 874/1752] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:43 2022] DELETE /identity/v3/projects/2a892199728048b6b608a988dc288447 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:44.007201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a8125-2583-4dd1-bdc5-e95c0fd20ff4 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.008332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a8125-2583-4dd1-bdc5-e95c0fd20ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.008800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a8125-2583-4dd1-bdc5-e95c0fd20ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.091436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1e1a8125-2583-4dd1-bdc5-e95c0fd20ff4 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:44.101811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e1a8125-2583-4dd1-bdc5-e95c0fd20ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:44.125215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3141d7-94ed-4fa2-b1d2-96f78cfc612e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:44.132823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:44.136601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.136601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.136601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.136601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:44.136985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:44.149752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 879/1753] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:44.150702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:44.165520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:44.198704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402248-73a6-47c2-a463-aa3fd36ee586 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:44.203273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:44.203903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.204721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.205094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.207103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:44.218764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:44.220338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:44.236430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 880/1754] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:44.236430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:44.236430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:44.249653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c229c09-460b-46a6-98d7-18afa5752b73 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:44.256761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7d560-9ad4-47c6-a992-ffc415bfcead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:44.257439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d560-9ad4-47c6-a992-ffc415bfcead admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.257729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d560-9ad4-47c6-a992-ffc415bfcead admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.258087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7d560-9ad4-47c6-a992-ffc415bfcead admin admin] PATH_INFO: `/v3/projects/3a25d779d6fa4fe1bfee073d4cc98f46/users/58b50942d8ff473d9f50fd254c59e6a9/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.273529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:44.277387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7d560-9ad4-47c6-a992-ffc415bfcead admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a25d779d6fa4fe1bfee073d4cc98f46, user_id=58b50942d8ff473d9f50fd254c59e6a9, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:44.280210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7d560-9ad4-47c6-a992-ffc415bfcead admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:44.328519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:44.387017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 875/1755] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:44.391661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec21069-a98d-440d-b819-52257b8c106b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.396089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec21069-a98d-440d-b819-52257b8c106b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.398183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec21069-a98d-440d-b819-52257b8c106b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.407664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 881/1756] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:44 2022] PUT /identity/v3/projects/3a25d779d6fa4fe1bfee073d4cc98f46/users/58b50942d8ff473d9f50fd254c59e6a9/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:44.413532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc308287-9d0a-4242-bf17-07e4318af6f8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.415936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc308287-9d0a-4242-bf17-07e4318af6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.416543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc308287-9d0a-4242-bf17-07e4318af6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.494176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7ec21069-a98d-440d-b819-52257b8c106b None None] MFA Rules not processed for user `e0f0bf68631642c197600f557e999adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:44.496216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7ec21069-a98d-440d-b819-52257b8c106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:44.528861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bc308287-9d0a-4242-bf17-07e4318af6f8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:44.530562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bc308287-9d0a-4242-bf17-07e4318af6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:44.742162 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 882/1757] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:44.746148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc308287-9d0a-4242-bf17-07e4318af6f8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:44.763194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc308287-9d0a-4242-bf17-07e4318af6f8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:44.771324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 876/1758] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:44.773418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec21069-a98d-440d-b819-52257b8c106b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:44.781215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cf3d-5074-4f88-9aa7-26d66eb6c59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:44.782410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cf3d-5074-4f88-9aa7-26d66eb6c59d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.782760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cf3d-5074-4f88-9aa7-26d66eb6c59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.783040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cf3d-5074-4f88-9aa7-26d66eb6c59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.783741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65cf3d-5074-4f88-9aa7-26d66eb6c59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:44.788620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65cf3d-5074-4f88-9aa7-26d66eb6c59d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:44.806410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec21069-a98d-440d-b819-52257b8c106b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:44.812945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:44.816127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.816127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.816127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.816127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:44.816127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:44.822473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:44.839675 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 883/1759] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:44.849648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cf3d-5074-4f88-9aa7-26d66eb6c59d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:44.876312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 877/1760] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:44.883025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:44.907723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08d404-fda1-4d49-96a5-11dcb348ebba admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:44.908062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cf3d-5074-4f88-9aa7-26d66eb6c59d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:44.912487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162491a-b206-424a-9ad0-7da74b9421af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:44.913330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162491a-b206-424a-9ad0-7da74b9421af admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.913714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162491a-b206-424a-9ad0-7da74b9421af admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.914098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162491a-b206-424a-9ad0-7da74b9421af admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.914858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162491a-b206-424a-9ad0-7da74b9421af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:44.916997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162491a-b206-424a-9ad0-7da74b9421af admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:44.931040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f4a65-2998-4a7e-8ed6-b57633cce989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:44.931787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4a65-2998-4a7e-8ed6-b57633cce989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:44.935161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4a65-2998-4a7e-8ed6-b57633cce989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:44.935161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4a65-2998-4a7e-8ed6-b57633cce989 admin admin] PATH_INFO: `/v3/projects/3a25d779d6fa4fe1bfee073d4cc98f46/users/58b50942d8ff473d9f50fd254c59e6a9/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:44.935161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f4a65-2998-4a7e-8ed6-b57633cce989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a25d779d6fa4fe1bfee073d4cc98f46, user_id=58b50942d8ff473d9f50fd254c59e6a9, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:44.947386 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f4a65-2998-4a7e-8ed6-b57633cce989 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:45.021877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 884/1761] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:44 2022] PUT /identity/v3/projects/3a25d779d6fa4fe1bfee073d4cc98f46/users/58b50942d8ff473d9f50fd254c59e6a9/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:45.033536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e69f-368f-4b10-b182-87701182441f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:45.034231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e69f-368f-4b10-b182-87701182441f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:45.035268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e69f-368f-4b10-b182-87701182441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:45.045541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 878/1762] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:44 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:25:45.050394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162491a-b206-424a-9ad0-7da74b9421af admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:45.095445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4ad1e69f-368f-4b10-b182-87701182441f None None] MFA Rules not processed for user `58b50942d8ff473d9f50fd254c59e6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:45.098315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ad1e69f-368f-4b10-b182-87701182441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:45.188209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162491a-b206-424a-9ad0-7da74b9421af admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:45.205263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea8d26-1324-4b40-b181-a3c72523d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:45.209130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8d26-1324-4b40-b181-a3c72523d75b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:45.209130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8d26-1324-4b40-b181-a3c72523d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:45.209130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea8d26-1324-4b40-b181-a3c72523d75b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:45.209130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea8d26-1324-4b40-b181-a3c72523d75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:45.216797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea8d26-1324-4b40-b181-a3c72523d75b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:45.340416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 885/1763] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:45.347799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 879/1764] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:45 2022] POST /identity/v3/users => generated 303 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:45.348388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c557-d63c-4380-8349-94ac13fd8b27 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:45.351926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c557-d63c-4380-8349-94ac13fd8b27 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:45.352481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c557-d63c-4380-8349-94ac13fd8b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:45.353201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea8d26-1324-4b40-b181-a3c72523d75b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:45.383500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea8d26-1324-4b40-b181-a3c72523d75b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:45.397585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-27c6c557-d63c-4380-8349-94ac13fd8b27 None None] MFA Rules not processed for user `9e755fa1e0ec4820a476b9807dfc3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:45.401761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-27c6c557-d63c-4380-8349-94ac13fd8b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:45.409272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:45.415578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:45.415966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:45.416263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:45.417016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:45.430242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:45.479675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 880/1765] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:25:45.480636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:45.490140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:45.528053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:45.564871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 886/1766] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:45.570068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6c557-d63c-4380-8349-94ac13fd8b27 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:45.586644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:45.609242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6c557-d63c-4380-8349-94ac13fd8b27 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:45.633286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced472-5916-49e3-83d2-200cd90f3ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:45.634305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced472-5916-49e3-83d2-200cd90f3ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:45.634805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced472-5916-49e3-83d2-200cd90f3ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:45.635294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ced472-5916-49e3-83d2-200cd90f3ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:45.636180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ced472-5916-49e3-83d2-200cd90f3ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:45.638145 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ced472-5916-49e3-83d2-200cd90f3ab5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:45.669801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 887/1767] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:45.675496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced472-5916-49e3-83d2-200cd90f3ab5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:45.726933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ced472-5916-49e3-83d2-200cd90f3ab5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:45.730482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712057a4-e3f3-4aaa-99d8-d7a36f97e3b9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:45.731937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c1337-d5b9-4624-901e-e30228474371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:45.732843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c1337-d5b9-4624-901e-e30228474371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:45.733235 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c1337-d5b9-4624-901e-e30228474371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:45.733707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c1337-d5b9-4624-901e-e30228474371 admin admin] PATH_INFO: `/v3/projects/5400067b9c6b4f4fb0f7745a8e6278bb/users/0b3bd2127de6423287a0c1015db64e3e/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:45.739230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c3d59-527e-40b8-84ee-7a6d7c5bdc4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:45.742249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c3d59-527e-40b8-84ee-7a6d7c5bdc4d service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:45.742569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c3d59-527e-40b8-84ee-7a6d7c5bdc4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:45.743161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c3d59-527e-40b8-84ee-7a6d7c5bdc4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:45.756084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c1337-d5b9-4624-901e-e30228474371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5400067b9c6b4f4fb0f7745a8e6278bb, user_id=0b3bd2127de6423287a0c1015db64e3e, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:45.760286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c1337-d5b9-4624-901e-e30228474371 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:45.784327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c3d59-527e-40b8-84ee-7a6d7c5bdc4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:45.784645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c3d59-527e-40b8-84ee-7a6d7c5bdc4d service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:45.816120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 881/1768] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:45.853771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 888/1769] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:45 2022] PUT /identity/v3/projects/5400067b9c6b4f4fb0f7745a8e6278bb/users/0b3bd2127de6423287a0c1015db64e3e/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:45.864869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05eca-c798-4723-bfac-cb7c2f00e756 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:45.865160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05eca-c798-4723-bfac-cb7c2f00e756 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:45.865440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a05eca-c798-4723-bfac-cb7c2f00e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:45.955130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c1337-d5b9-4624-901e-e30228474371 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:45.968855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-77a05eca-c798-4723-bfac-cb7c2f00e756 None None] MFA Rules not processed for user `0b3bd2127de6423287a0c1015db64e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:45.970107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-77a05eca-c798-4723-bfac-cb7c2f00e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:46.144354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c1337-d5b9-4624-901e-e30228474371 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:46.150830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 882/1770] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:46.154838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a05eca-c798-4723-bfac-cb7c2f00e756 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:46.156672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:46.158515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:46.158515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:46.158515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] PATH_INFO: `/v3/users/8db4ef8d9cf04eb6a2de41eaca302803` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:46.159334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db4ef8d9cf04eb6a2de41eaca302803)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:46.181247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:46.182214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a05eca-c798-4723-bfac-cb7c2f00e756 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:46.191813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023876e2-d272-43b9-8804-dc2b3ef41846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:46.197617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023876e2-d272-43b9-8804-dc2b3ef41846 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:46.198130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023876e2-d272-43b9-8804-dc2b3ef41846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:46.198565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023876e2-d272-43b9-8804-dc2b3ef41846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:46.202195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023876e2-d272-43b9-8804-dc2b3ef41846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:46.206342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023876e2-d272-43b9-8804-dc2b3ef41846 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:46.333159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 883/1771] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:46 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:46.334490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023876e2-d272-43b9-8804-dc2b3ef41846 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:46.415474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db4ef8d9cf04eb6a2de41eaca302803'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:46.436229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db4ef8d9cf04eb6a2de41eaca302803'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:46.444883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023876e2-d272-43b9-8804-dc2b3ef41846 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:46.460951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:46.463805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:46.465567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:46.466431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:46.467209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:46.469653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db4ef8d9cf04eb6a2de41eaca302803'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:46.492984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:46.574482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db4ef8d9cf04eb6a2de41eaca302803'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:46.575594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c01d9caa-59c8-4b48-a078-1d8bfc39d9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db4ef8d9cf04eb6a2de41eaca302803'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:46.589093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 889/1772] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:45 2022] DELETE /identity/v3/users/8db4ef8d9cf04eb6a2de41eaca302803 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:46.590880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828547cb-cd23-481c-a425-bb9dc04e1cd6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:46.591745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828547cb-cd23-481c-a425-bb9dc04e1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:46.591745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828547cb-cd23-481c-a425-bb9dc04e1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:46.605549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 884/1773] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:46 2022] POST /identity/v3/users => generated 309 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:25:46.609601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:46.612765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:46.658700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59735d-0da4-4cf0-9b31-b2b266818903 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:46.682989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:46.704383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-828547cb-cd23-481c-a425-bb9dc04e1cd6 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:46.705821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-828547cb-cd23-481c-a425-bb9dc04e1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:46.826688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994c67-404e-4dc4-b20d-ed6bab6a2b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:46.827588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994c67-404e-4dc4-b20d-ed6bab6a2b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:46.829097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994c67-404e-4dc4-b20d-ed6bab6a2b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:46.829476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994c67-404e-4dc4-b20d-ed6bab6a2b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:46.831141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994c67-404e-4dc4-b20d-ed6bab6a2b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:46.834297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:46.838726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994c67-404e-4dc4-b20d-ed6bab6a2b14 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:46.871526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 885/1774] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:25:46.872684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994c67-404e-4dc4-b20d-ed6bab6a2b14 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:46.906169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994c67-404e-4dc4-b20d-ed6bab6a2b14 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:46.922094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b08d2-970a-4727-a2e1-cf9edd4fbf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:46.922490 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 890/1775] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:46.930457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b08d2-970a-4727-a2e1-cf9edd4fbf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:46.933507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b08d2-970a-4727-a2e1-cf9edd4fbf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:46.934181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b08d2-970a-4727-a2e1-cf9edd4fbf44 admin admin] PATH_INFO: `/v3/projects/c48e7606b7ed4ba0b35dfc63c774358e/users/bb9af614398747dabe46b09816f4c1c8/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:46.956774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828547cb-cd23-481c-a425-bb9dc04e1cd6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:46.958574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-828547cb-cd23-481c-a425-bb9dc04e1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:46.982307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b08d2-970a-4727-a2e1-cf9edd4fbf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48e7606b7ed4ba0b35dfc63c774358e, user_id=bb9af614398747dabe46b09816f4c1c8, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:46.993350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b08d2-970a-4727-a2e1-cf9edd4fbf44 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:47.099587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 886/1776] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:46 2022] PUT /identity/v3/projects/c48e7606b7ed4ba0b35dfc63c774358e/users/bb9af614398747dabe46b09816f4c1c8/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:47.101082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b08d2-970a-4727-a2e1-cf9edd4fbf44 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:47.169364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828547cb-cd23-481c-a425-bb9dc04e1cd6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:47.321000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf64d0-2bfd-4dcb-b572-7bea51f6a82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:47.326192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf64d0-2bfd-4dcb-b572-7bea51f6a82d service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:47.326192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf64d0-2bfd-4dcb-b572-7bea51f6a82d service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:47.326192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf64d0-2bfd-4dcb-b572-7bea51f6a82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:47.329742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b08d2-970a-4727-a2e1-cf9edd4fbf44 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:47.350471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf64d0-2bfd-4dcb-b572-7bea51f6a82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:47.354695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf64d0-2bfd-4dcb-b572-7bea51f6a82d service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:47.356512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b304ec0-8cb7-41b1-8914-382ae550e5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:47.361420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304ec0-8cb7-41b1-8914-382ae550e5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:47.361712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304ec0-8cb7-41b1-8914-382ae550e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:47.362562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b304ec0-8cb7-41b1-8914-382ae550e5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:47.362791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b304ec0-8cb7-41b1-8914-382ae550e5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:47.369143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 891/1777] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:25:47.373776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b304ec0-8cb7-41b1-8914-382ae550e5e7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:47.401925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 887/1778] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:47.409659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf64d0-2bfd-4dcb-b572-7bea51f6a82d service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:47.434137 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf64d0-2bfd-4dcb-b572-7bea51f6a82d service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:47.451727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:47.452958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:47.453301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:47.453619 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] PATH_INFO: `/v3/projects/c48e7606b7ed4ba0b35dfc63c774358e/users/bb9af614398747dabe46b09816f4c1c8/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:47.456156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48e7606b7ed4ba0b35dfc63c774358e, user_id=bb9af614398747dabe46b09816f4c1c8, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:47.475350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:47.502608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 892/1779] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:47 2022] PUT /identity/v3/projects/c48e7606b7ed4ba0b35dfc63c774358e/users/bb9af614398747dabe46b09816f4c1c8/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:47.505669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c49c4-17bb-48c8-ad9a-ca972522ed5e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:47.506135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c49c4-17bb-48c8-ad9a-ca972522ed5e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:47.507064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c49c4-17bb-48c8-ad9a-ca972522ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:47.590904 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4f6c49c4-17bb-48c8-ad9a-ca972522ed5e None None] MFA Rules not processed for user `bb9af614398747dabe46b09816f4c1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:47.610353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4f6c49c4-17bb-48c8-ad9a-ca972522ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:47.869462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 888/1780] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:47.884885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:47.887659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:48.083604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f143941-5b08-42b1-8f21-51e0dfe31942 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:48.103260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a67f1-943e-43ed-af7e-71f642199549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:48.118414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a67f1-943e-43ed-af7e-71f642199549 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:48.118944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a67f1-943e-43ed-af7e-71f642199549 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:48.119594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a67f1-943e-43ed-af7e-71f642199549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:48.141285 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a67f1-943e-43ed-af7e-71f642199549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:48.144014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a67f1-943e-43ed-af7e-71f642199549 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:48.178625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 893/1781] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:47 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:48.452775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c49c4-17bb-48c8-ad9a-ca972522ed5e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:48.480517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:48.579510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e652f8-8098-43a8-b498-4727d57f238e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:48.580118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e652f8-8098-43a8-b498-4727d57f238e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:48.580118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e652f8-8098-43a8-b498-4727d57f238e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:48.583503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 894/1782] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:25:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:25:48.623657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f60c-3797-43bc-a8ed-238ba225ffbe None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:48.624153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f60c-3797-43bc-a8ed-238ba225ffbe None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:48.624471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f60c-3797-43bc-a8ed-238ba225ffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:48.630452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c49c4-17bb-48c8-ad9a-ca972522ed5e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:48.636687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:48.637813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:48.638301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:48.638968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] PATH_INFO: `/v3/users/0b3bd2127de6423287a0c1015db64e3e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:48.641071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3bd2127de6423287a0c1015db64e3e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:48.643342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:48.671079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2115f60c-3797-43bc-a8ed-238ba225ffbe None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:48.674213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2115f60c-3797-43bc-a8ed-238ba225ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:48.811488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:48.858051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3bd2127de6423287a0c1015db64e3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:48.875951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3bd2127de6423287a0c1015db64e3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:48.986296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3bd2127de6423287a0c1015db64e3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:49.018637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 895/1783] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:25:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:49.037738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3bd2127de6423287a0c1015db64e3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:49.041764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3bd2127de6423287a0c1015db64e3e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:49.078031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 889/1784] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:48 2022] DELETE /identity/v3/users/0b3bd2127de6423287a0c1015db64e3e => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:49.081114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f019-c41f-43e5-962a-1befaf987152 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:49.081979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f019-c41f-43e5-962a-1befaf987152 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:49.082408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f019-c41f-43e5-962a-1befaf987152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:49.118147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b7a2f019-c41f-43e5-962a-1befaf987152 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:49.118702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7a2f019-c41f-43e5-962a-1befaf987152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:49.150011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:49.151457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:49.285265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 896/1785] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:49.315850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2f019-c41f-43e5-962a-1befaf987152 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:49.318220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7a2f019-c41f-43e5-962a-1befaf987152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:49.367946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371fafa-4084-47ef-928a-8f89bb24dc62 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:49.378404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:49.379067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:49.379349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:49.379694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] PATH_INFO: `/v3/users/b4d34a4e54d740f5a5ca318614c03a61` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:49.380914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d34a4e54d740f5a5ca318614c03a61)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:49.383389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:49.497490 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2f019-c41f-43e5-962a-1befaf987152 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:49.501797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac1e84-c642-426d-99d1-1c0fa2d7c0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:49.503642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac1e84-c642-426d-99d1-1c0fa2d7c0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:49.504026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac1e84-c642-426d-99d1-1c0fa2d7c0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:49.504352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac1e84-c642-426d-99d1-1c0fa2d7c0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:49.530341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac1e84-c642-426d-99d1-1c0fa2d7c0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:49.535212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac1e84-c642-426d-99d1-1c0fa2d7c0a7 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:49.550259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 897/1786] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:49.643876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124bc4-25d0-43f7-8767-7c0aa7f8e19b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:49.644577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124bc4-25d0-43f7-8767-7c0aa7f8e19b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:49.644577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124bc4-25d0-43f7-8767-7c0aa7f8e19b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:49.647315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 898/1787] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:25:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:25:49.672865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:49.699079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d34a4e54d740f5a5ca318614c03a61'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:49.712406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d34a4e54d740f5a5ca318614c03a61'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:49.781330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc499-ec84-42c4-8521-ce3e8708d97b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:49.782457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc499-ec84-42c4-8521-ce3e8708d97b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:49.782457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc499-ec84-42c4-8521-ce3e8708d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:49.822160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-aabdc499-ec84-42c4-8521-ce3e8708d97b None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:49.823631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aabdc499-ec84-42c4-8521-ce3e8708d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:49.825804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d34a4e54d740f5a5ca318614c03a61'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:49.881617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d34a4e54d740f5a5ca318614c03a61'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:49.888521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f4b6b5d4-c76f-41fb-b744-a4429c6aa7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d34a4e54d740f5a5ca318614c03a61'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:49.907144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 890/1788] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:49 2022] DELETE /identity/v3/users/b4d34a4e54d740f5a5ca318614c03a61 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:49.917451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387ac14-23e6-44a1-819a-0c015111511f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:49.917766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387ac14-23e6-44a1-819a-0c015111511f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:49.918044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387ac14-23e6-44a1-819a-0c015111511f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:49.965921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:49.990371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d387ac14-23e6-44a1-819a-0c015111511f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:49.997623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d387ac14-23e6-44a1-819a-0c015111511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:50.001722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 899/1789] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:25:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:50.070753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc499-ec84-42c4-8521-ce3e8708d97b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:50.072445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aabdc499-ec84-42c4-8521-ce3e8708d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:50.099998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc499-ec84-42c4-8521-ce3e8708d97b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:50.270694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 891/1790] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:50.274194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387ac14-23e6-44a1-819a-0c015111511f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:50.282193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d387ac14-23e6-44a1-819a-0c015111511f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:50.284645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:50.285470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:50.289820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:50.290129 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:50.295223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:50.326424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:50.328072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:50.346814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 900/1791] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:50.376107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387ac14-23e6-44a1-819a-0c015111511f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:50.378088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:50.381935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:50.386803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:50.408608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:50.409014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:50.409302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:50.446169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:50.448401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:50.520857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 892/1792] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:25:50.533639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fc7e8-c051-40dd-91b4-31b885f68280 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:50.552394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e213-fc9e-4ddb-9df8-c400c7c08733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:50.552394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e213-fc9e-4ddb-9df8-c400c7c08733 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:50.552394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e213-fc9e-4ddb-9df8-c400c7c08733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:50.552394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e213-fc9e-4ddb-9df8-c400c7c08733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:50.571418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4e213-fc9e-4ddb-9df8-c400c7c08733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:50.574109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4e213-fc9e-4ddb-9df8-c400c7c08733 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:50.596628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 901/1793] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:25:50.672499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:50.674175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:50.694938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90baf2-d361-428b-bbbd-d92fb84c0528 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:50.703297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:50.704169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:50.704345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:50.704583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] PATH_INFO: `/v3/projects/61c93d72dfc746efa5c9906a82b3d892` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:50.705788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c93d72dfc746efa5c9906a82b3d892)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:50.708270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:50.901463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c93d72dfc746efa5c9906a82b3d892', 'request_id': 'req-b0b88792-ea6d-431b-a39d-e589d19f5c38'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.024887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c93d72dfc746efa5c9906a82b3d892', 'request_id': 'req-b0b88792-ea6d-431b-a39d-e589d19f5c38'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.041058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c93d72dfc746efa5c9906a82b3d892', 'request_id': 'req-b0b88792-ea6d-431b-a39d-e589d19f5c38'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.074611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] The token cache is being invalidate because project 61c93d72dfc746efa5c9906a82b3d892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:51.074922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.077187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.081218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 893/1794] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:50 2022] DELETE /identity/v3/projects/61c93d72dfc746efa5c9906a82b3d892 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:51.085583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e213-fc9e-4ddb-9df8-c400c7c08733 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:51.109186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e213-fc9e-4ddb-9df8-c400c7c08733 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:51.156914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:51.158518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:51.249997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:51.402462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:51.403104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:51.403391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:51.403671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] PATH_INFO: `/v3/users/58b50942d8ff473d9f50fd254c59e6a9` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:51.406340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b50942d8ff473d9f50fd254c59e6a9)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:51.406640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b88792-ea6d-431b-a39d-e589d19f5c38 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:51.408328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:51.414682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:51.425119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:51.425119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:51.425119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] PATH_INFO: `/v3/projects/5400067b9c6b4f4fb0f7745a8e6278bb` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:51.425119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5400067b9c6b4f4fb0f7745a8e6278bb)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:51.425119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:51.588805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:51.734578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b50942d8ff473d9f50fd254c59e6a9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.735262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5400067b9c6b4f4fb0f7745a8e6278bb', 'request_id': 'req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.767329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b50942d8ff473d9f50fd254c59e6a9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.818903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b50942d8ff473d9f50fd254c59e6a9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.849438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5400067b9c6b4f4fb0f7745a8e6278bb', 'request_id': 'req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.858360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5400067b9c6b4f4fb0f7745a8e6278bb', 'request_id': 'req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.870298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] The token cache is being invalidate because project 5400067b9c6b4f4fb0f7745a8e6278bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:51.870810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.871650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.874019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 894/1795] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:51 2022] DELETE /identity/v3/projects/5400067b9c6b4f4fb0f7745a8e6278bb => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:51.883754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:51.885067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:51.947769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b50942d8ff473d9f50fd254c59e6a9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.950771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b50942d8ff473d9f50fd254c59e6a9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:51.968504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 902/1796] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:51 2022] DELETE /identity/v3/users/58b50942d8ff473d9f50fd254c59e6a9 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:52.039690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca80f1-ada8-44ca-b37d-1a5a78d462e7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:52.183348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:52.226038 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:52.226995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:52.227285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:52.227560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] PATH_INFO: `/v3/users/bb9af614398747dabe46b09816f4c1c8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:52.229684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9af614398747dabe46b09816f4c1c8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:52.266039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:52.579900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9af614398747dabe46b09816f4c1c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:52.594363 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:52.595785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9af614398747dabe46b09816f4c1c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:52.596256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:52.660590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c05ec-96ad-4fb3-a603-d1fd7f595565 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:52.682220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:52.682439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9af614398747dabe46b09816f4c1c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:52.682976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:52.683553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:52.684123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] PATH_INFO: `/v3/projects/2fc35e593af34d00b980e25920d82fb3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:52.686345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc35e593af34d00b980e25920d82fb3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:52.688698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:52.699811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9af614398747dabe46b09816f4c1c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:52.700761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9af614398747dabe46b09816f4c1c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:52.713093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 895/1797] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:51 2022] DELETE /identity/v3/users/bb9af614398747dabe46b09816f4c1c8 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:52.867904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc35e593af34d00b980e25920d82fb3', 'request_id': 'req-ad39fef9-0585-4d48-b708-441fec694bfc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:52.876543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc35e593af34d00b980e25920d82fb3', 'request_id': 'req-ad39fef9-0585-4d48-b708-441fec694bfc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:52.886131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc35e593af34d00b980e25920d82fb3', 'request_id': 'req-ad39fef9-0585-4d48-b708-441fec694bfc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:52.893044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:52.894806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:53.005488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] The token cache is being invalidate because project 2fc35e593af34d00b980e25920d82fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:53.005855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.006844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.016405 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 903/1798] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:52 2022] DELETE /identity/v3/projects/2fc35e593af34d00b980e25920d82fb3 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:53.020340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:53.022707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:53.080546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40925fcb-3ada-4d76-8e8a-d123cba29257 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:53.153457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39fef9-0585-4d48-b708-441fec694bfc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:53.159771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:53.160896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:53.161418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:53.161699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] PATH_INFO: `/v3/users/c1eda6a7807643d082055fe559ae6feb` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:53.168638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1eda6a7807643d082055fe559ae6feb)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:53.172120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:53.251864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:53.253087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:53.253554 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:53.253852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] PATH_INFO: `/v3/projects/3a25d779d6fa4fe1bfee073d4cc98f46` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:53.256464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a25d779d6fa4fe1bfee073d4cc98f46)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:53.259369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:53.331744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:53.391705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:53.421884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1eda6a7807643d082055fe559ae6feb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.438747 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1eda6a7807643d082055fe559ae6feb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.470949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1eda6a7807643d082055fe559ae6feb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.496209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a25d779d6fa4fe1bfee073d4cc98f46', 'request_id': 'req-9532111a-6f4a-479b-aaa5-a68cb4db1a23'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.568868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1eda6a7807643d082055fe559ae6feb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.570208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ddc6115a-a133-4906-961b-87375cfd93c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1eda6a7807643d082055fe559ae6feb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.579283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 904/1799] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:53 2022] DELETE /identity/v3/users/c1eda6a7807643d082055fe559ae6feb => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:53.694296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a25d779d6fa4fe1bfee073d4cc98f46', 'request_id': 'req-9532111a-6f4a-479b-aaa5-a68cb4db1a23'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.706770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a25d779d6fa4fe1bfee073d4cc98f46', 'request_id': 'req-9532111a-6f4a-479b-aaa5-a68cb4db1a23'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.763263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] The token cache is being invalidate because project 3a25d779d6fa4fe1bfee073d4cc98f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:53.763263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.763263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:53.771762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 896/1800] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:52 2022] DELETE /identity/v3/projects/3a25d779d6fa4fe1bfee073d4cc98f46 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:53.778288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f367010-38cf-41f4-b492-ef3b368f1dd9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:53.779169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f367010-38cf-41f4-b492-ef3b368f1dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:53.780175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f367010-38cf-41f4-b492-ef3b368f1dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:53.815452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8f367010-38cf-41f4-b492-ef3b368f1dd9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:53.819709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8f367010-38cf-41f4-b492-ef3b368f1dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:53.859135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:53.860823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:53.968189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 905/1801] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:53.980926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5959-bccc-4491-b83e-71163ad39032 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:53.981355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5959-bccc-4491-b83e-71163ad39032 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:53.981708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5959-bccc-4491-b83e-71163ad39032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:53.985739 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532111a-6f4a-479b-aaa5-a68cb4db1a23 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:53.990845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:53.993974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:53.993974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:53.993974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] PATH_INFO: `/v3/projects/c48e7606b7ed4ba0b35dfc63c774358e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:53.993974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48e7606b7ed4ba0b35dfc63c774358e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:53.998606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:54.039703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-feac5959-bccc-4491-b83e-71163ad39032 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:54.041096 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-feac5959-bccc-4491-b83e-71163ad39032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:54.056483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 906/1802] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:54.058090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5959-bccc-4491-b83e-71163ad39032 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:54.074009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5959-bccc-4491-b83e-71163ad39032 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:54.090685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:54.091276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:54.091683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:54.091875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:54.092616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:54.092922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:54.094628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:54.123144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 907/1803] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:54.125299 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:54.157594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853a70e-efaf-404f-9b76-c2233161b2d0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:54.179025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48e7606b7ed4ba0b35dfc63c774358e', 'request_id': 'req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:54.308825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48e7606b7ed4ba0b35dfc63c774358e', 'request_id': 'req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:54.330062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48e7606b7ed4ba0b35dfc63c774358e', 'request_id': 'req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:54.337078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:54.337791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:54.338094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:54.338393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:54.339040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:54.341232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:54.384073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] The token cache is being invalidate because project c48e7606b7ed4ba0b35dfc63c774358e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:54.384939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:54.385145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-bb3860df-2e95-4858-bd7c-2f9a24e9dc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:54.388777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 897/1804] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:53 2022] DELETE /identity/v3/projects/c48e7606b7ed4ba0b35dfc63c774358e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:54.400406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f6d30-b145-475c-a2c8-12d0f6fb5d19 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:54.401411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f6d30-b145-475c-a2c8-12d0f6fb5d19 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:54.404661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f6d30-b145-475c-a2c8-12d0f6fb5d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:54.474571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 908/1805] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:54 2022] POST /identity/v3/projects => generated 375 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:54.478732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:54.482423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:54.499651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c48f6d30-b145-475c-a2c8-12d0f6fb5d19 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:54.502920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c48f6d30-b145-475c-a2c8-12d0f6fb5d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:54.510521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:54.625468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcdb17-2d08-4194-be17-79e9b316d2e4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:54.632156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:54.642017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc87da8-c2f7-4908-b91f-2d05dc011e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:54.642946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87da8-c2f7-4908-b91f-2d05dc011e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:54.643276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87da8-c2f7-4908-b91f-2d05dc011e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:54.643608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc87da8-c2f7-4908-b91f-2d05dc011e65 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:54.644332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc87da8-c2f7-4908-b91f-2d05dc011e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:54.647505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc87da8-c2f7-4908-b91f-2d05dc011e65 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:54.717158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 898/1806] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:54.736822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f614c4-1e5c-47ca-9c77-ad8a57415fc6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:54.737308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f614c4-1e5c-47ca-9c77-ad8a57415fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:54.737528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f614c4-1e5c-47ca-9c77-ad8a57415fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:54.789786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e1f614c4-1e5c-47ca-9c77-ad8a57415fc6 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:54.792835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e1f614c4-1e5c-47ca-9c77-ad8a57415fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:54.798744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 909/1807] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:54 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:54.805994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc87da8-c2f7-4908-b91f-2d05dc011e65 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:54.813881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 899/1808] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:54.820701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f614c4-1e5c-47ca-9c77-ad8a57415fc6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:54.838129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f614c4-1e5c-47ca-9c77-ad8a57415fc6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:54.846991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:54.847984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:54.848537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:54.849127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:54.850009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:54.850545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:54.855049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:54.877119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc87da8-c2f7-4908-b91f-2d05dc011e65 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:54.878588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 900/1809] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:54.881311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:54.901759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12dc49-5f64-4579-ad39-55b077395837 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:54.908707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:54.909307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ac42-3f2e-42fb-bbeb-94efec4ff0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:54.909430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:54.909712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:54.909881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:54.910582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:54.911573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ac42-3f2e-42fb-bbeb-94efec4ff0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:54.912690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ac42-3f2e-42fb-bbeb-94efec4ff0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:54.913580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55ac42-3f2e-42fb-bbeb-94efec4ff0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:54.914969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55ac42-3f2e-42fb-bbeb-94efec4ff0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:54.916605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:54.918164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55ac42-3f2e-42fb-bbeb-94efec4ff0d5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:54.948194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 910/1810] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:54.949165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:54.951951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:55.005863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a963c-617c-4162-948c-706e211f2ec2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:55.015958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 901/1811] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:54 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:55.019805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ac42-3f2e-42fb-bbeb-94efec4ff0d5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:55.031254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:55.034943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:55.035503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:55.037084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] PATH_INFO: `/v3/projects/a73ced7e553749a49720274c6dc744cc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:55.042346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73ced7e553749a49720274c6dc744cc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:55.048341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:55.210351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55ac42-3f2e-42fb-bbeb-94efec4ff0d5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:55.230154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825b6b1-9cf2-4c62-910b-62e2007d9716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:55.231172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825b6b1-9cf2-4c62-910b-62e2007d9716 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:55.231639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825b6b1-9cf2-4c62-910b-62e2007d9716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:55.232170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825b6b1-9cf2-4c62-910b-62e2007d9716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:55.233046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825b6b1-9cf2-4c62-910b-62e2007d9716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:55.234955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825b6b1-9cf2-4c62-910b-62e2007d9716 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:55.276977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73ced7e553749a49720274c6dc744cc', 'request_id': 'req-033b9ea3-00b2-4891-9f65-081acecf0b22'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:55.279014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 902/1812] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:55.281277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825b6b1-9cf2-4c62-910b-62e2007d9716 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:55.290218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73ced7e553749a49720274c6dc744cc', 'request_id': 'req-033b9ea3-00b2-4891-9f65-081acecf0b22'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:55.305459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73ced7e553749a49720274c6dc744cc', 'request_id': 'req-033b9ea3-00b2-4891-9f65-081acecf0b22'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:55.329225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825b6b1-9cf2-4c62-910b-62e2007d9716 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:55.402967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] The token cache is being invalidate because project a73ced7e553749a49720274c6dc744cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:55.403274 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:55.404093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:55.407306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 911/1813] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:54 2022] DELETE /identity/v3/projects/a73ced7e553749a49720274c6dc744cc => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:55.408448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:55.430717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:55.541911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:55.542896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:55.543409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:55.544090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:55.544990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:55.547176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:55.590734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b9ea3-00b2-4891-9f65-081acecf0b22 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:55.599453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:55.600234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:55.600527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:55.600896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] PATH_INFO: `/v3/projects/3e10a8b64ad04a1e8847703f1be3dc60/users/384724e7ebbc45a99a944a8d21781340/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:55.652734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 903/1814] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:55 2022] POST /identity/v3/users => generated 285 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:55.652926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e10a8b64ad04a1e8847703f1be3dc60, user_id=384724e7ebbc45a99a944a8d21781340, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:55.654939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:55.657141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:55.667808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:55.674162 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0b042-ab0a-4bc1-a364-dc4e320d682f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:55.696834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:55.697764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:55.698251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:55.698731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] PATH_INFO: `/v3/users/c78424f27c0e412aadd12179d80174dd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:55.700179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78424f27c0e412aadd12179d80174dd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:55.702594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:55.740262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:55.758034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 912/1815] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:55 2022] PUT /identity/v3/projects/3e10a8b64ad04a1e8847703f1be3dc60/users/384724e7ebbc45a99a944a8d21781340/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:55.758034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:55.758178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:55.760136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:55.912877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2408504-7357-4516-8dc0-c4fa68f485ff admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:55.922720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91f0c-9d3a-41a8-adc4-5343a765492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:55.923550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91f0c-9d3a-41a8-adc4-5343a765492b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:55.923884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91f0c-9d3a-41a8-adc4-5343a765492b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:55.924320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91f0c-9d3a-41a8-adc4-5343a765492b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:55.925086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91f0c-9d3a-41a8-adc4-5343a765492b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:55.929476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91f0c-9d3a-41a8-adc4-5343a765492b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:55.944783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 913/1816] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:55.946722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426936de-7eee-4799-ba40-8fd998b17cfd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:55.947278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426936de-7eee-4799-ba40-8fd998b17cfd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:55.947753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426936de-7eee-4799-ba40-8fd998b17cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:55.983354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78424f27c0e412aadd12179d80174dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:56.006863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78424f27c0e412aadd12179d80174dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:56.026273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-426936de-7eee-4799-ba40-8fd998b17cfd None None] MFA Rules not processed for user `384724e7ebbc45a99a944a8d21781340`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:56.028070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-426936de-7eee-4799-ba40-8fd998b17cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:56.080182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78424f27c0e412aadd12179d80174dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:56.124948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78424f27c0e412aadd12179d80174dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:56.127724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78424f27c0e412aadd12179d80174dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:56.148895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 904/1817] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:25:55 2022] DELETE /identity/v3/users/c78424f27c0e412aadd12179d80174dd => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:56.153284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:56.160590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:56.299698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 914/1818] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:56.313280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426936de-7eee-4799-ba40-8fd998b17cfd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:56.315651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-426936de-7eee-4799-ba40-8fd998b17cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:56.409023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63210a7e-ee4b-4fe1-86d7-9b9889dee17b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:56.437822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53612ae-7eec-4033-9ecf-5c0b30bd049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:56.438464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53612ae-7eec-4033-9ecf-5c0b30bd049b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:56.438747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53612ae-7eec-4033-9ecf-5c0b30bd049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:56.439046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53612ae-7eec-4033-9ecf-5c0b30bd049b admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:56.439682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53612ae-7eec-4033-9ecf-5c0b30bd049b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:56.441469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53612ae-7eec-4033-9ecf-5c0b30bd049b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:56.497054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426936de-7eee-4799-ba40-8fd998b17cfd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:56.500368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 905/1819] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:56.506156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53612ae-7eec-4033-9ecf-5c0b30bd049b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:56.527014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53612ae-7eec-4033-9ecf-5c0b30bd049b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:56.527775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:56.541309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca670b-9ba0-47ab-a93c-eec6125a880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:56.542476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca670b-9ba0-47ab-a93c-eec6125a880e admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:56.542933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca670b-9ba0-47ab-a93c-eec6125a880e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:56.543380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca670b-9ba0-47ab-a93c-eec6125a880e admin admin] PATH_INFO: `/v3/projects/a9ecddc44dde458db1c058eb94f233aa/users/b20f84c449a240ce9fb37f6b29b155f8/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:56.581857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca670b-9ba0-47ab-a93c-eec6125a880e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ecddc44dde458db1c058eb94f233aa, user_id=b20f84c449a240ce9fb37f6b29b155f8, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:56.584769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca670b-9ba0-47ab-a93c-eec6125a880e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:56.617767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06f4a6-7b13-43fb-a829-bc86d4e9296e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00283447a1a6405b952e541a13c91110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:56.618400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f4a6-7b13-43fb-a829-bc86d4e9296e service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:56.618686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f4a6-7b13-43fb-a829-bc86d4e9296e service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:56.618965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06f4a6-7b13-43fb-a829-bc86d4e9296e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:56.702080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 906/1820] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:56 2022] PUT /identity/v3/projects/a9ecddc44dde458db1c058eb94f233aa/users/b20f84c449a240ce9fb37f6b29b155f8/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:56.705187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28c56c-5b58-46e3-8904-b251b060078a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:56.705494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28c56c-5b58-46e3-8904-b251b060078a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:56.705752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28c56c-5b58-46e3-8904-b251b060078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:56.726816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06f4a6-7b13-43fb-a829-bc86d4e9296e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:56.726816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06f4a6-7b13-43fb-a829-bc86d4e9296e service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:56.739755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 915/1821] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:25:56.759781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ee28c56c-5b58-46e3-8904-b251b060078a None None] MFA Rules not processed for user `b20f84c449a240ce9fb37f6b29b155f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:56.762556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ee28c56c-5b58-46e3-8904-b251b060078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:56.942039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:56.951994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 907/1822] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:56.956195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06f4a6-7b13-43fb-a829-bc86d4e9296e service glance] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:56.969445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06f4a6-7b13-43fb-a829-bc86d4e9296e service glance] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:57.067458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563928b-f988-4742-81bc-b84ac028c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:57.068074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563928b-f988-4742-81bc-b84ac028c83f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:57.068378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563928b-f988-4742-81bc-b84ac028c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:57.068654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563928b-f988-4742-81bc-b84ac028c83f admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:57.069367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563928b-f988-4742-81bc-b84ac028c83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:57.071872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563928b-f988-4742-81bc-b84ac028c83f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:57.347046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 916/1823] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:56 2022] POST /identity/v3/projects => generated 367 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:25:57.352225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28c56c-5b58-46e3-8904-b251b060078a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:57.365272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28c56c-5b58-46e3-8904-b251b060078a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:57.437329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c757734-8f9b-4c7b-b3bd-c1cb8e4e0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:57.438061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c757734-8f9b-4c7b-b3bd-c1cb8e4e0a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:57.438340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c757734-8f9b-4c7b-b3bd-c1cb8e4e0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:57.438610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c757734-8f9b-4c7b-b3bd-c1cb8e4e0a7d admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:57.439260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c757734-8f9b-4c7b-b3bd-c1cb8e4e0a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:57.441390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c757734-8f9b-4c7b-b3bd-c1cb8e4e0a7d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:57.542636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 908/1824] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:57 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:57.546597 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563928b-f988-4742-81bc-b84ac028c83f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:57.560942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563928b-f988-4742-81bc-b84ac028c83f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:57.567693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b98bf2-b41b-4a40-8c2b-cc7b406c36e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:57.568642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98bf2-b41b-4a40-8c2b-cc7b406c36e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:57.568642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98bf2-b41b-4a40-8c2b-cc7b406c36e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:57.568900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b98bf2-b41b-4a40-8c2b-cc7b406c36e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:57.569643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b98bf2-b41b-4a40-8c2b-cc7b406c36e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:57.572806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b98bf2-b41b-4a40-8c2b-cc7b406c36e8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:57.594887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 917/1825] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:57.595388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c757734-8f9b-4c7b-b3bd-c1cb8e4e0a7d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:57.606606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c757734-8f9b-4c7b-b3bd-c1cb8e4e0a7d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:57.628746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:57.630156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:57.630449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:57.630732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] PATH_INFO: `/v3/projects/560dadd6e9b84fe88ad571b9aef13bfa/users/a142cb2262394167aaa3bfc22611ccf4/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:57.661503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560dadd6e9b84fe88ad571b9aef13bfa, user_id=a142cb2262394167aaa3bfc22611ccf4, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:57.665571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:57.791334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 909/1826] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:57 2022] PUT /identity/v3/projects/560dadd6e9b84fe88ad571b9aef13bfa/users/a142cb2262394167aaa3bfc22611ccf4/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:57.795387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b98bf2-b41b-4a40-8c2b-cc7b406c36e8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:57.806202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b98bf2-b41b-4a40-8c2b-cc7b406c36e8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:57.872872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:57.889783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361612a-8c1d-44bc-b3c4-c670bc1e147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:57.890913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361612a-8c1d-44bc-b3c4-c670bc1e147c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:57.891448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361612a-8c1d-44bc-b3c4-c670bc1e147c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:57.891855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361612a-8c1d-44bc-b3c4-c670bc1e147c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:57.893634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361612a-8c1d-44bc-b3c4-c670bc1e147c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:57.896427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361612a-8c1d-44bc-b3c4-c670bc1e147c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:57.901859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:57.905312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:57.914394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 918/1827] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:57.931474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae94c-da68-4522-a6a7-71ce64f080f4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:57.931648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361612a-8c1d-44bc-b3c4-c670bc1e147c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:57.936513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:57.937154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:57.937541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:57.937728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] PATH_INFO: `/v3/projects/a5b4921c58134c9fa3cbb1b8b539712e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:57.938923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b4921c58134c9fa3cbb1b8b539712e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:57.941075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:57.968519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361612a-8c1d-44bc-b3c4-c670bc1e147c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:57.982877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dbfe0-6613-4224-b3bc-2c67d3339080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:57.983514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbfe0-6613-4224-b3bc-2c67d3339080 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:57.985377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbfe0-6613-4224-b3bc-2c67d3339080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:57.985683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbfe0-6613-4224-b3bc-2c67d3339080 admin admin] PATH_INFO: `/v3/projects/560dadd6e9b84fe88ad571b9aef13bfa/users/a142cb2262394167aaa3bfc22611ccf4/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:57.993316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dbfe0-6613-4224-b3bc-2c67d3339080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560dadd6e9b84fe88ad571b9aef13bfa, user_id=a142cb2262394167aaa3bfc22611ccf4, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:58.002578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dbfe0-6613-4224-b3bc-2c67d3339080 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:58.044398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 919/1828] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:57 2022] PUT /identity/v3/projects/560dadd6e9b84fe88ad571b9aef13bfa/users/a142cb2262394167aaa3bfc22611ccf4/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:58.053302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8a2d4-1a31-496e-8ea1-e4bd20e0fca4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.053604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8a2d4-1a31-496e-8ea1-e4bd20e0fca4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.053942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8a2d4-1a31-496e-8ea1-e4bd20e0fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.074073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b4921c58134c9fa3cbb1b8b539712e', 'request_id': 'req-f0da0982-163b-4a79-88ac-fa8a1e09927b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:58.101474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-69d8a2d4-1a31-496e-8ea1-e4bd20e0fca4 None None] MFA Rules not processed for user `a142cb2262394167aaa3bfc22611ccf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:58.103290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-69d8a2d4-1a31-496e-8ea1-e4bd20e0fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:58.178675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b4921c58134c9fa3cbb1b8b539712e', 'request_id': 'req-f0da0982-163b-4a79-88ac-fa8a1e09927b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:58.186077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b4921c58134c9fa3cbb1b8b539712e', 'request_id': 'req-f0da0982-163b-4a79-88ac-fa8a1e09927b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:58.199919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] The token cache is being invalidate because project a5b4921c58134c9fa3cbb1b8b539712e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:25:58.200498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:58.201320 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0da0982-163b-4a79-88ac-fa8a1e09927b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:25:58.208551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 910/1829] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:25:57 2022] DELETE /identity/v3/projects/a5b4921c58134c9fa3cbb1b8b539712e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:25:58.212474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba06be-086f-402a-a5a1-584bc6d3c510 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.212474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba06be-086f-402a-a5a1-584bc6d3c510 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.212474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba06be-086f-402a-a5a1-584bc6d3c510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.216394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 920/1830] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:58.231593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8a2d4-1a31-496e-8ea1-e4bd20e0fca4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:58.233138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-69d8a2d4-1a31-496e-8ea1-e4bd20e0fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:58.243026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7eba06be-086f-402a-a5a1-584bc6d3c510 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:58.244255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7eba06be-086f-402a-a5a1-584bc6d3c510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:58.312959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:58.330193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8a2d4-1a31-496e-8ea1-e4bd20e0fca4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:58.334263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:58.334879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.335161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.335433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.338175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:58.340722 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 911/1831] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:58.350514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ca1d-f239-4f12-8fab-c409889023c8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.351048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ca1d-f239-4f12-8fab-c409889023c8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.351328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ca1d-f239-4f12-8fab-c409889023c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.355902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:58.357392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:58.373515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5ec9ca1d-f239-4f12-8fab-c409889023c8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:58.374163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 921/1832] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:25:58.377549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5ec9ca1d-f239-4f12-8fab-c409889023c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:58.390804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 912/1833] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:25:58.392592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:58.406655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab385b2b-3d43-4f38-9411-402fbd6dbf5c service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:58.417834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:58.418365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.418762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.419117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.419883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:25:58.421425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:58.422314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:58.438836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 922/1834] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:25:58.440143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9ca1d-f239-4f12-8fab-c409889023c8 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:58.457950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9ca1d-f239-4f12-8fab-c409889023c8 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:58.464692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36068b10-123f-4637-8f86-976c17c01edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:58.465292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36068b10-123f-4637-8f86-976c17c01edb admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.465574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36068b10-123f-4637-8f86-976c17c01edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.465852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36068b10-123f-4637-8f86-976c17c01edb admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.466536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36068b10-123f-4637-8f86-976c17c01edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:58.468982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36068b10-123f-4637-8f86-976c17c01edb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:58.565941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 913/1835] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:25:58 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:58.570642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:58.581448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08c977-6fcd-49bc-a4b7-0cfe20789e40 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:58.647719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:25:58.661791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529c8b7-0415-4276-8bd5-92de67addb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:58.663779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c8b7-0415-4276-8bd5-92de67addb08 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.663779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c8b7-0415-4276-8bd5-92de67addb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.663779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529c8b7-0415-4276-8bd5-92de67addb08 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.663779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529c8b7-0415-4276-8bd5-92de67addb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:58.665884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529c8b7-0415-4276-8bd5-92de67addb08 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:58.813848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 923/1836] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:25:58 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:25:58.817888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36068b10-123f-4637-8f86-976c17c01edb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:58.836130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36068b10-123f-4637-8f86-976c17c01edb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:58.841520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4f37-a25c-40a7-a4fc-3b4ea8536e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:58.843255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4f37-a25c-40a7-a4fc-3b4ea8536e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.843255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4f37-a25c-40a7-a4fc-3b4ea8536e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.843255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd4f37-a25c-40a7-a4fc-3b4ea8536e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.843647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd4f37-a25c-40a7-a4fc-3b4ea8536e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:58.845022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd4f37-a25c-40a7-a4fc-3b4ea8536e4a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:58.856560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 914/1837] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:58.867188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529c8b7-0415-4276-8bd5-92de67addb08 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:58.877943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529c8b7-0415-4276-8bd5-92de67addb08 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:58.883893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64491de-8445-4a74-aebd-c9e043ef1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:58.884792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64491de-8445-4a74-aebd-c9e043ef1f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.885071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64491de-8445-4a74-aebd-c9e043ef1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.885344 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64491de-8445-4a74-aebd-c9e043ef1f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.886208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64491de-8445-4a74-aebd-c9e043ef1f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:58.887842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64491de-8445-4a74-aebd-c9e043ef1f33 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:58.900029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 924/1838] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:25:58.904328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4f37-a25c-40a7-a4fc-3b4ea8536e4a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:58.915962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd4f37-a25c-40a7-a4fc-3b4ea8536e4a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:58.920727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:58.927192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:58.927192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:58.927192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] PATH_INFO: `/v3/projects/507ec339e2b248c9b7ad367fcb6b2b0a/users/176deac4b617427b9d49d352787732d5/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:58.937733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507ec339e2b248c9b7ad367fcb6b2b0a, user_id=176deac4b617427b9d49d352787732d5, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:58.940459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:59.070891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 915/1839] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:25:58 2022] PUT /identity/v3/projects/507ec339e2b248c9b7ad367fcb6b2b0a/users/176deac4b617427b9d49d352787732d5/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:25:59.076195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073af7f-b7c7-422d-88c9-6c31a3a57dbb None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:59.076733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073af7f-b7c7-422d-88c9-6c31a3a57dbb None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:59.076819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073af7f-b7c7-422d-88c9-6c31a3a57dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:59.102666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4073af7f-b7c7-422d-88c9-6c31a3a57dbb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:25:59.102666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4073af7f-b7c7-422d-88c9-6c31a3a57dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:59.162289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 925/1840] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:25:59.172405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:25:59.174120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:25:59.235719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fbcfd-939b-48a7-aadc-ad61cf533d45 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:25:59.239578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012e7f1-0577-4cdc-849d-9690d51d3c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:25:59.240228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012e7f1-0577-4cdc-849d-9690d51d3c35 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:25:59.240542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012e7f1-0577-4cdc-849d-9690d51d3c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:25:59.240807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012e7f1-0577-4cdc-849d-9690d51d3c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:25:59.249816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012e7f1-0577-4cdc-849d-9690d51d3c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:25:59.251432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012e7f1-0577-4cdc-849d-9690d51d3c35 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:25:59.263176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 916/1841] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:01.245613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8be1f-02cc-4e80-9d88-48e42a69185e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:01.246223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8be1f-02cc-4e80-9d88-48e42a69185e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:01.246223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8be1f-02cc-4e80-9d88-48e42a69185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:01.353303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-41d8be1f-02cc-4e80-9d88-48e42a69185e None None] MFA Rules not processed for user `176deac4b617427b9d49d352787732d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:01.354990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-41d8be1f-02cc-4e80-9d88-48e42a69185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:01.501909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 926/1842] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:01.507150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012e7f1-0577-4cdc-849d-9690d51d3c35 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:01.522788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012e7f1-0577-4cdc-849d-9690d51d3c35 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:01.524648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:01.525567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:01.525848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:01.526478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:01.529457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:01.533507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:01.671580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 917/1843] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:01 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:01.676393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8be1f-02cc-4e80-9d88-48e42a69185e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:01.695751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8be1f-02cc-4e80-9d88-48e42a69185e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:01.762509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:01.770041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794273e-d34e-46b3-92ef-23f95bc6cf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:01.770708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794273e-d34e-46b3-92ef-23f95bc6cf55 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:01.770966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794273e-d34e-46b3-92ef-23f95bc6cf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:01.771238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794273e-d34e-46b3-92ef-23f95bc6cf55 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:01.771890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794273e-d34e-46b3-92ef-23f95bc6cf55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:01.773974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794273e-d34e-46b3-92ef-23f95bc6cf55 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:01.870796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:01.872753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:01.886423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55dd6b-e474-49d2-bfca-140db2579c73 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:01.892275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:01.893312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:01.893745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:01.896502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] PATH_INFO: `/v3/users/b20f84c449a240ce9fb37f6b29b155f8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:01.896502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20f84c449a240ce9fb37f6b29b155f8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:01.897770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:01.900020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 927/1844] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:01 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:01.904174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794273e-d34e-46b3-92ef-23f95bc6cf55 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:01.916826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794273e-d34e-46b3-92ef-23f95bc6cf55 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:01.923658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d631-29d6-4bfe-bb88-4598cb4ccf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:01.924340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d631-29d6-4bfe-bb88-4598cb4ccf1e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:01.924662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d631-29d6-4bfe-bb88-4598cb4ccf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:01.924943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7d631-29d6-4bfe-bb88-4598cb4ccf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:01.925655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d631-29d6-4bfe-bb88-4598cb4ccf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:01.929636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7d631-29d6-4bfe-bb88-4598cb4ccf1e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:01.952188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 928/1845] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:01.957010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d631-29d6-4bfe-bb88-4598cb4ccf1e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:01.970055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7d631-29d6-4bfe-bb88-4598cb4ccf1e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:01.978543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291bb50-6fb0-415c-9226-13b9058050b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:01.979274 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bb50-6fb0-415c-9226-13b9058050b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:01.979560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bb50-6fb0-415c-9226-13b9058050b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:01.979840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bb50-6fb0-415c-9226-13b9058050b0 admin admin] PATH_INFO: `/v3/projects/9a5a009f62634786afebd2c1d7bd2ed1/users/f715d12a956c45979237f14e229578d4/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:02.002783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291bb50-6fb0-415c-9226-13b9058050b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5a009f62634786afebd2c1d7bd2ed1, user_id=f715d12a956c45979237f14e229578d4, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:02.006642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291bb50-6fb0-415c-9226-13b9058050b0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:02.659112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 929/1846] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:01 2022] PUT /identity/v3/projects/9a5a009f62634786afebd2c1d7bd2ed1/users/f715d12a956c45979237f14e229578d4/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:02.670601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291bb50-6fb0-415c-9226-13b9058050b0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:02.749952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291bb50-6fb0-415c-9226-13b9058050b0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:02.754655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264ad28-9897-4be0-b845-5cb83a23e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:02.755348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264ad28-9897-4be0-b845-5cb83a23e5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:02.755626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264ad28-9897-4be0-b845-5cb83a23e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:02.755896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264ad28-9897-4be0-b845-5cb83a23e5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:02.756573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264ad28-9897-4be0-b845-5cb83a23e5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:02.758166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264ad28-9897-4be0-b845-5cb83a23e5c4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:02.768576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 930/1847] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:02.772804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264ad28-9897-4be0-b845-5cb83a23e5c4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:02.788191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264ad28-9897-4be0-b845-5cb83a23e5c4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:02.796316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626bec5-a420-49d3-a045-841bd6436e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:02.797015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626bec5-a420-49d3-a045-841bd6436e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:02.797303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626bec5-a420-49d3-a045-841bd6436e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:02.797600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626bec5-a420-49d3-a045-841bd6436e03 admin admin] PATH_INFO: `/v3/projects/9a5a009f62634786afebd2c1d7bd2ed1/users/f715d12a956c45979237f14e229578d4/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:02.799745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626bec5-a420-49d3-a045-841bd6436e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5a009f62634786afebd2c1d7bd2ed1, user_id=f715d12a956c45979237f14e229578d4, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:02.803737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626bec5-a420-49d3-a045-841bd6436e03 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:02.816286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 931/1848] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:02 2022] PUT /identity/v3/projects/9a5a009f62634786afebd2c1d7bd2ed1/users/f715d12a956c45979237f14e229578d4/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:02.899153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20f84c449a240ce9fb37f6b29b155f8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:02.907505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20f84c449a240ce9fb37f6b29b155f8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:02.913710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:03.036785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20f84c449a240ce9fb37f6b29b155f8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:03.053023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20f84c449a240ce9fb37f6b29b155f8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:03.054417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20f84c449a240ce9fb37f6b29b155f8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:03.062791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 918/1849] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:01 2022] DELETE /identity/v3/users/b20f84c449a240ce9fb37f6b29b155f8 => generated 0 bytes in 1192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:03.068151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117e96-3d65-4767-b8d0-0365a91cdacf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:03.068565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117e96-3d65-4767-b8d0-0365a91cdacf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:03.068913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117e96-3d65-4767-b8d0-0365a91cdacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:03.090000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1b117e96-3d65-4767-b8d0-0365a91cdacf None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:03.091220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b117e96-3d65-4767-b8d0-0365a91cdacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:03.154532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 932/1850] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:03.164695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:03.166326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:03.250361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce0e09-cff5-40da-bbce-4dc57f7b11b0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:03.256502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5ae4-c352-4f5e-a131-2317da36f16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:03.257527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5ae4-c352-4f5e-a131-2317da36f16d service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:03.257847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5ae4-c352-4f5e-a131-2317da36f16d service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:03.258333 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5ae4-c352-4f5e-a131-2317da36f16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:03.271719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c5ae4-c352-4f5e-a131-2317da36f16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:03.273720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c5ae4-c352-4f5e-a131-2317da36f16d service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:03.288280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 919/1851] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:04.116600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b117e96-3d65-4767-b8d0-0365a91cdacf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:04.119754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1b117e96-3d65-4767-b8d0-0365a91cdacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:04.139396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b117e96-3d65-4767-b8d0-0365a91cdacf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:04.148233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:04.149653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:04.150315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:04.151005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] PATH_INFO: `/v3/projects/a9ecddc44dde458db1c058eb94f233aa` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:04.152832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ecddc44dde458db1c058eb94f233aa)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:04.161331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:04.335168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ecddc44dde458db1c058eb94f233aa', 'request_id': 'req-a3730a8b-01c0-457c-b0c9-fca510dc991d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.348900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ecddc44dde458db1c058eb94f233aa', 'request_id': 'req-a3730a8b-01c0-457c-b0c9-fca510dc991d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.358149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ecddc44dde458db1c058eb94f233aa', 'request_id': 'req-a3730a8b-01c0-457c-b0c9-fca510dc991d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.489400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] The token cache is being invalidate because project a9ecddc44dde458db1c058eb94f233aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:04.490194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.491160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a3730a8b-01c0-457c-b0c9-fca510dc991d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.493234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 933/1852] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:04 2022] DELETE /identity/v3/projects/a9ecddc44dde458db1c058eb94f233aa => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:04.497510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5ae4-c352-4f5e-a131-2317da36f16d service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:04.515030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5ae4-c352-4f5e-a131-2317da36f16d service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:04.550414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:04.593201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404acc39-f4b5-44ce-a896-b72158b9afb8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:04.595622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404acc39-f4b5-44ce-a896-b72158b9afb8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:04.595622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404acc39-f4b5-44ce-a896-b72158b9afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:04.603566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:04.604389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:04.604743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:04.605071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] PATH_INFO: `/v3/users/a142cb2262394167aaa3bfc22611ccf4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:04.606331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a142cb2262394167aaa3bfc22611ccf4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:04.609112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:04.657440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-404acc39-f4b5-44ce-a896-b72158b9afb8 None None] MFA Rules not processed for user `f715d12a956c45979237f14e229578d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:04.658762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-404acc39-f4b5-44ce-a896-b72158b9afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:04.786844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a142cb2262394167aaa3bfc22611ccf4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.794030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a142cb2262394167aaa3bfc22611ccf4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.796443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 934/1853] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:04.805248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f6366-a8d3-4f95-8862-019a9bb506d9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:04.805542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f6366-a8d3-4f95-8862-019a9bb506d9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:04.805862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f6366-a8d3-4f95-8862-019a9bb506d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:04.832839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-537f6366-a8d3-4f95-8862-019a9bb506d9 None None] MFA Rules not processed for user `176deac4b617427b9d49d352787732d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:04.834839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-537f6366-a8d3-4f95-8862-019a9bb506d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:04.859806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a142cb2262394167aaa3bfc22611ccf4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.875335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a142cb2262394167aaa3bfc22611ccf4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.876130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a142cb2262394167aaa3bfc22611ccf4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:04.883155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 920/1854] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:04 2022] DELETE /identity/v3/users/a142cb2262394167aaa3bfc22611ccf4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:04.883974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:04.885935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:04.915039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 935/1855] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:04.929325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f6366-a8d3-4f95-8862-019a9bb506d9 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:04.932500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-537f6366-a8d3-4f95-8862-019a9bb506d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:04.978724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb21a-bbae-47bb-9032-866b8159577c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:04.993065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:04.993895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:04.994266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:04.994642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] PATH_INFO: `/v3/users/32c57872abde449d9d6754dd63638fb0` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:04.996913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c57872abde449d9d6754dd63638fb0)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:04.999370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:05.060676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f6366-a8d3-4f95-8862-019a9bb506d9 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:05.135018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546e2f-31bd-4adc-9809-1bc9e0ce67f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:05.135702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546e2f-31bd-4adc-9809-1bc9e0ce67f7 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:05.135934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546e2f-31bd-4adc-9809-1bc9e0ce67f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:05.136194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546e2f-31bd-4adc-9809-1bc9e0ce67f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:05.138176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2b546e2f-31bd-4adc-9809-1bc9e0ce67f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:05.219061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c57872abde449d9d6754dd63638fb0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.227124 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c57872abde449d9d6754dd63638fb0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.231818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546e2f-31bd-4adc-9809-1bc9e0ce67f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:05.234751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546e2f-31bd-4adc-9809-1bc9e0ce67f7 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:05.244906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 936/1856] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:05.275994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c57872abde449d9d6754dd63638fb0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.293011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c57872abde449d9d6754dd63638fb0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.293651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c57872abde449d9d6754dd63638fb0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.300203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 921/1857] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:04 2022] DELETE /identity/v3/users/32c57872abde449d9d6754dd63638fb0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:05.304563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa199315-5a6d-4622-b6ea-5b8850af7b5e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:05.304819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa199315-5a6d-4622-b6ea-5b8850af7b5e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:05.305097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa199315-5a6d-4622-b6ea-5b8850af7b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:05.331791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-aa199315-5a6d-4622-b6ea-5b8850af7b5e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:05.334139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa199315-5a6d-4622-b6ea-5b8850af7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:05.406930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 937/1858] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:05.418998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:05.420664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:05.484842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa199315-5a6d-4622-b6ea-5b8850af7b5e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:05.489877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa199315-5a6d-4622-b6ea-5b8850af7b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:05.506105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1157b8f-b9a7-43b8-9d53-89dd4c702c5d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:05.513449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa199315-5a6d-4622-b6ea-5b8850af7b5e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:05.527952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a579da-aa77-4277-929f-da89c182c00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:05.529378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a579da-aa77-4277-929f-da89c182c00a service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:05.529989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a579da-aa77-4277-929f-da89c182c00a service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:05.530307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a579da-aa77-4277-929f-da89c182c00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:05.535981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:05.543438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:05.543438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:05.543438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] PATH_INFO: `/v3/projects/560dadd6e9b84fe88ad571b9aef13bfa` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:05.543438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560dadd6e9b84fe88ad571b9aef13bfa)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:05.544022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a579da-aa77-4277-929f-da89c182c00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:05.546251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a579da-aa77-4277-929f-da89c182c00a service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:05.547529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:05.578720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 922/1859] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:05.669290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560dadd6e9b84fe88ad571b9aef13bfa', 'request_id': 'req-e762e616-f31b-4ec2-9510-c0b0c38f8a62'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.678342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560dadd6e9b84fe88ad571b9aef13bfa', 'request_id': 'req-e762e616-f31b-4ec2-9510-c0b0c38f8a62'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.685117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560dadd6e9b84fe88ad571b9aef13bfa', 'request_id': 'req-e762e616-f31b-4ec2-9510-c0b0c38f8a62'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.735929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:05.776196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] The token cache is being invalidate because project 560dadd6e9b84fe88ad571b9aef13bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:05.776527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.777470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e762e616-f31b-4ec2-9510-c0b0c38f8a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:05.780476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 938/1860] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:05 2022] DELETE /identity/v3/projects/560dadd6e9b84fe88ad571b9aef13bfa => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:05.785194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9390c1-2eff-4268-ac1c-e0d31ac7c1fb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:05.786159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9390c1-2eff-4268-ac1c-e0d31ac7c1fb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:05.786683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9390c1-2eff-4268-ac1c-e0d31ac7c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:05.836211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2c9390c1-2eff-4268-ac1c-e0d31ac7c1fb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:05.837465 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2c9390c1-2eff-4268-ac1c-e0d31ac7c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:05.939394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 923/1861] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:05.948059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59235c-faaa-4c46-998f-bfca53eddaef None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:05.948891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59235c-faaa-4c46-998f-bfca53eddaef None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:05.949344 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59235c-faaa-4c46-998f-bfca53eddaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:05.975394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4b59235c-faaa-4c46-998f-bfca53eddaef None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:05.977559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4b59235c-faaa-4c46-998f-bfca53eddaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:05.986105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 939/1862] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:05.991217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9390c1-2eff-4268-ac1c-e0d31ac7c1fb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.002963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9390c1-2eff-4268-ac1c-e0d31ac7c1fb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.011613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9f54f-e30d-4957-8ee7-3c230ae99aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:06.012724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f54f-e30d-4957-8ee7-3c230ae99aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.013316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f54f-e30d-4957-8ee7-3c230ae99aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.014004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f54f-e30d-4957-8ee7-3c230ae99aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.014825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9f54f-e30d-4957-8ee7-3c230ae99aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:06.015279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9f54f-e30d-4957-8ee7-3c230ae99aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:06.036207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c73-0f3d-4163-a167-988cae1f8b44 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.036542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c73-0f3d-4163-a167-988cae1f8b44 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.036823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e666c73-0f3d-4163-a167-988cae1f8b44 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.038206 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 940/1863] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:26:06.040545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9f54f-e30d-4957-8ee7-3c230ae99aa7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:06.057254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 924/1864] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:06.065224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666c73-0f3d-4163-a167-988cae1f8b44 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.082130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e666c73-0f3d-4163-a167-988cae1f8b44 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.084910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3cbf-4eaf-4258-a05a-54d73fd0f58f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.085200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3cbf-4eaf-4258-a05a-54d73fd0f58f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.085518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3cbf-4eaf-4258-a05a-54d73fd0f58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.088555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:06.102598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.102598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.102598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.106003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:06.106003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:06.139515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6bef3cbf-4eaf-4258-a05a-54d73fd0f58f None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:06.140764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6bef3cbf-4eaf-4258-a05a-54d73fd0f58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:06.242942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 925/1865] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:26:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:06.252630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 941/1866] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:06 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:06.256898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef3cbf-4eaf-4258-a05a-54d73fd0f58f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.274587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef3cbf-4eaf-4258-a05a-54d73fd0f58f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.321927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.323641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:06.383931 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:06.384600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.384883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.385161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.385853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:06.387983 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:06.497089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 926/1867] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:06 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:06.497089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.501043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:06.510008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e397c6-3a31-4ac6-9845-97d784111b04 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.515090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3518c3-958e-4868-95d4-026eea5b0f36 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.522605 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:06.522975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3c8a7-a5b1-4349-abcf-d6639dd64c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:06.523716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.523716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.530316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] PATH_INFO: `/v3/projects/e2ee9e4da41d44d98b77499c24dc4114` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.530316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ee9e4da41d44d98b77499c24dc4114)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:06.530534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3c8a7-a5b1-4349-abcf-d6639dd64c49 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.530534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3c8a7-a5b1-4349-abcf-d6639dd64c49 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.530534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3c8a7-a5b1-4349-abcf-d6639dd64c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.533997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:06.546005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3c8a7-a5b1-4349-abcf-d6639dd64c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:06.550390 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3c8a7-a5b1-4349-abcf-d6639dd64c49 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:06.568867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 942/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:06.570930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3c8a7-a5b1-4349-abcf-d6639dd64c49 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.587419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3c8a7-a5b1-4349-abcf-d6639dd64c49 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.595375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d10c7-ede5-4f54-9834-794cc28eba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:06.596229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d10c7-ede5-4f54-9834-794cc28eba80 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.596697 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d10c7-ede5-4f54-9834-794cc28eba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.597074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d10c7-ede5-4f54-9834-794cc28eba80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.597919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d10c7-ede5-4f54-9834-794cc28eba80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:06.599933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d10c7-ede5-4f54-9834-794cc28eba80 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:06.615462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 943/1869] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:06.628068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d10c7-ede5-4f54-9834-794cc28eba80 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.634431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d10c7-ede5-4f54-9834-794cc28eba80 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.642106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3cf8-9aae-4617-b1b6-0abca3fe8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:06.642729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3cf8-9aae-4617-b1b6-0abca3fe8af8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.643381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3cf8-9aae-4617-b1b6-0abca3fe8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.643381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d3cf8-9aae-4617-b1b6-0abca3fe8af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.653316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d3cf8-9aae-4617-b1b6-0abca3fe8af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:06.653316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d3cf8-9aae-4617-b1b6-0abca3fe8af8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:06.662979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 944/1870] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:06.677808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3cf8-9aae-4617-b1b6-0abca3fe8af8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.691423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d3cf8-9aae-4617-b1b6-0abca3fe8af8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.697661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d97ee-0059-4066-9995-997622ffaf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:06.698453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d97ee-0059-4066-9995-997622ffaf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.698804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d97ee-0059-4066-9995-997622ffaf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.699158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d97ee-0059-4066-9995-997622ffaf59 admin admin] PATH_INFO: `/v3/projects/11a1e819a41845419bb013b24b091d5b/users/c47f290e69f4460985c880867c44b711/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.740229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ee9e4da41d44d98b77499c24dc4114', 'request_id': 'req-32896879-5688-4c8e-99ae-b3b8ad973339'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:06.742874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d97ee-0059-4066-9995-997622ffaf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a1e819a41845419bb013b24b091d5b, user_id=c47f290e69f4460985c880867c44b711, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:06.745517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d97ee-0059-4066-9995-997622ffaf59 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:06.795693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ee9e4da41d44d98b77499c24dc4114', 'request_id': 'req-32896879-5688-4c8e-99ae-b3b8ad973339'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:06.808255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ee9e4da41d44d98b77499c24dc4114', 'request_id': 'req-32896879-5688-4c8e-99ae-b3b8ad973339'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:06.822012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] The token cache is being invalidate because project e2ee9e4da41d44d98b77499c24dc4114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:06.822521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:06.823337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:06.825274 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 927/1871] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:06 2022] DELETE /identity/v3/projects/e2ee9e4da41d44d98b77499c24dc4114 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:06.825903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:06.828906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:06.833405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:06.901640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 945/1872] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:06 2022] PUT /identity/v3/projects/11a1e819a41845419bb013b24b091d5b/users/c47f290e69f4460985c880867c44b711/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:06.903326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f23bc9-07a6-4ce6-a874-366cde78c3f3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:06.903602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f23bc9-07a6-4ce6-a874-366cde78c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:06.903870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f23bc9-07a6-4ce6-a874-366cde78c3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:06.938616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-33f23bc9-07a6-4ce6-a874-366cde78c3f3 None None] MFA Rules not processed for user `c47f290e69f4460985c880867c44b711`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:06.939002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32896879-5688-4c8e-99ae-b3b8ad973339 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:06.940938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-33f23bc9-07a6-4ce6-a874-366cde78c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:07.009077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:07.009981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:07.012767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:07.012767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] PATH_INFO: `/v3/users/6345099a38a7490da823d0301f3ce223` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:07.013392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6345099a38a7490da823d0301f3ce223)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:07.016681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:07.048238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 946/1873] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:07.049753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f23bc9-07a6-4ce6-a874-366cde78c3f3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:07.052168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-33f23bc9-07a6-4ce6-a874-366cde78c3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:07.068937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f23bc9-07a6-4ce6-a874-366cde78c3f3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:07.080371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792353f0-085b-41c9-87cf-51d1b9b6e10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:07.085802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792353f0-085b-41c9-87cf-51d1b9b6e10a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:07.085802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792353f0-085b-41c9-87cf-51d1b9b6e10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:07.085802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792353f0-085b-41c9-87cf-51d1b9b6e10a admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:07.085802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792353f0-085b-41c9-87cf-51d1b9b6e10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:07.087205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792353f0-085b-41c9-87cf-51d1b9b6e10a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:07.233306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 947/1874] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:07 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:07.234389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792353f0-085b-41c9-87cf-51d1b9b6e10a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:07.308961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6345099a38a7490da823d0301f3ce223'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:07.316132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6345099a38a7490da823d0301f3ce223'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:07.347227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792353f0-085b-41c9-87cf-51d1b9b6e10a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:07.352881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184eb14-1981-4434-9ffd-720a36c8a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:07.353489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184eb14-1981-4434-9ffd-720a36c8a430 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:07.353767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184eb14-1981-4434-9ffd-720a36c8a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:07.354038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184eb14-1981-4434-9ffd-720a36c8a430 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:07.354857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184eb14-1981-4434-9ffd-720a36c8a430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:07.356824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184eb14-1981-4434-9ffd-720a36c8a430 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:07.385080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6345099a38a7490da823d0301f3ce223'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:07.402118 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6345099a38a7490da823d0301f3ce223'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:07.402981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6345099a38a7490da823d0301f3ce223'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:07.409690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 928/1875] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:06 2022] DELETE /identity/v3/users/6345099a38a7490da823d0301f3ce223 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:07.482903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 948/1876] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:07 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:07.486982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:07.489545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:07.593093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efba43-5320-4701-9143-3dce4794ead0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:07.602961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac113ba-70da-43c2-a8d4-51d6b99c9265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:07.604447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac113ba-70da-43c2-a8d4-51d6b99c9265 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:07.605407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac113ba-70da-43c2-a8d4-51d6b99c9265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:07.606642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac113ba-70da-43c2-a8d4-51d6b99c9265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:07.608075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac113ba-70da-43c2-a8d4-51d6b99c9265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:07.617758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac113ba-70da-43c2-a8d4-51d6b99c9265 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:07.636630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 929/1877] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:07.643735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184eb14-1981-4434-9ffd-720a36c8a430 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:07.651994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184eb14-1981-4434-9ffd-720a36c8a430 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:07.670106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb0fee-04cd-4faf-bf99-414c25c70c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:07.670829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0fee-04cd-4faf-bf99-414c25c70c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:07.671111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0fee-04cd-4faf-bf99-414c25c70c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:07.675043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb0fee-04cd-4faf-bf99-414c25c70c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:07.675043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb0fee-04cd-4faf-bf99-414c25c70c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:07.676421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb0fee-04cd-4faf-bf99-414c25c70c6b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:07.694380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 949/1878] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:07.699359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac113ba-70da-43c2-a8d4-51d6b99c9265 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:07.711534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac113ba-70da-43c2-a8d4-51d6b99c9265 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:07.717670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c9914-b12e-427c-8206-af41817a0dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:07.718422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c9914-b12e-427c-8206-af41817a0dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:07.718771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c9914-b12e-427c-8206-af41817a0dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:07.719660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c9914-b12e-427c-8206-af41817a0dc1 admin admin] PATH_INFO: `/v3/projects/82ad11ca2f5c43efa53cbf18a716e05e/users/4b3f1245382e47debd540f75f92ddffd/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:07.737178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c9914-b12e-427c-8206-af41817a0dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ad11ca2f5c43efa53cbf18a716e05e, user_id=4b3f1245382e47debd540f75f92ddffd, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:07.743502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c9914-b12e-427c-8206-af41817a0dc1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:07.840339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 930/1879] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:07 2022] PUT /identity/v3/projects/82ad11ca2f5c43efa53cbf18a716e05e/users/4b3f1245382e47debd540f75f92ddffd/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:07.850480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6692d-24c7-4a4d-ab24-65e79d36b093 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:07.850657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6692d-24c7-4a4d-ab24-65e79d36b093 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:07.850927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6692d-24c7-4a4d-ab24-65e79d36b093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:07.891934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-90c6692d-24c7-4a4d-ab24-65e79d36b093 None None] MFA Rules not processed for user `4b3f1245382e47debd540f75f92ddffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:07.897122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-90c6692d-24c7-4a4d-ab24-65e79d36b093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:07.946526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:07.962498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 950/1880] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:07.968593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c9914-b12e-427c-8206-af41817a0dc1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:07.997259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6692d-24c7-4a4d-ab24-65e79d36b093 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:07.998887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-90c6692d-24c7-4a4d-ab24-65e79d36b093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:08.060756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c9914-b12e-427c-8206-af41817a0dc1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.067575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32c10-f7f7-48c8-889b-6b0ab82d8761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.067854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32c10-f7f7-48c8-889b-6b0ab82d8761 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.068135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32c10-f7f7-48c8-889b-6b0ab82d8761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.068443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d32c10-f7f7-48c8-889b-6b0ab82d8761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.069086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d32c10-f7f7-48c8-889b-6b0ab82d8761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.071004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d32c10-f7f7-48c8-889b-6b0ab82d8761 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.104001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6692d-24c7-4a4d-ab24-65e79d36b093 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.108552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.109182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.109457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.109731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] PATH_INFO: `/v3/projects/a90881ae1bc44b508316aa1525b77263` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.110853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90881ae1bc44b508316aa1525b77263)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.112778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.168929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 931/1881] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:07 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:08.172697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32c10-f7f7-48c8-889b-6b0ab82d8761 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.233099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d32c10-f7f7-48c8-889b-6b0ab82d8761 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.235679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90881ae1bc44b508316aa1525b77263', 'request_id': 'req-36a65870-c2f2-4893-8dee-e558cce3fe25'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:08.242377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90881ae1bc44b508316aa1525b77263', 'request_id': 'req-36a65870-c2f2-4893-8dee-e558cce3fe25'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:08.247833 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90881ae1bc44b508316aa1525b77263', 'request_id': 'req-36a65870-c2f2-4893-8dee-e558cce3fe25'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:08.290232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.290879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.291160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.291434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.292065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.294035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.315950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] The token cache is being invalidate because project a90881ae1bc44b508316aa1525b77263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:08.315950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:08.315950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-36a65870-c2f2-4893-8dee-e558cce3fe25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:08.318607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 951/1882] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:07 2022] DELETE /identity/v3/projects/a90881ae1bc44b508316aa1525b77263 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:08.323790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e446d-e1b5-41fc-9a02-85b354fc7675 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.324070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e446d-e1b5-41fc-9a02-85b354fc7675 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.324362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e446d-e1b5-41fc-9a02-85b354fc7675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.344034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-925e446d-e1b5-41fc-9a02-85b354fc7675 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:08.345425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-925e446d-e1b5-41fc-9a02-85b354fc7675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:08.350819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 932/1883] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:08 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:08.354481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.354908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 952/1884] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:08.356152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:08.362665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58910f6-49c9-46b2-817d-2efba1d75514 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.363722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58910f6-49c9-46b2-817d-2efba1d75514 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.364153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58910f6-49c9-46b2-817d-2efba1d75514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.369869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e4c87-eb8b-4329-b225-3e2d592fcdf1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.375295 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e664-55ce-4568-a976-36d36c78be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.375913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e664-55ce-4568-a976-36d36c78be20 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.376198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e664-55ce-4568-a976-36d36c78be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.376588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e664-55ce-4568-a976-36d36c78be20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.377335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431e664-55ce-4568-a976-36d36c78be20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.379601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431e664-55ce-4568-a976-36d36c78be20 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.388060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f58910f6-49c9-46b2-817d-2efba1d75514 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:08.389570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f58910f6-49c9-46b2-817d-2efba1d75514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:08.392043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 933/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:08.396112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e664-55ce-4568-a976-36d36c78be20 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.399575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 953/1886] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:08.403278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58910f6-49c9-46b2-817d-2efba1d75514 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.410508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e664-55ce-4568-a976-36d36c78be20 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.413797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58910f6-49c9-46b2-817d-2efba1d75514 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.415650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ffa9a-73b3-4303-bb23-91a2eb9de4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.416440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffa9a-73b3-4303-bb23-91a2eb9de4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.416818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffa9a-73b3-4303-bb23-91a2eb9de4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.417231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffa9a-73b3-4303-bb23-91a2eb9de4d0 admin admin] PATH_INFO: `/v3/projects/dbd22b3cf9e04f2c9d13566f8285fd2e/users/dae68cfac68440b09a650d2b930935dc/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.418883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.419303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.419581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.421964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.423020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:08.423417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.426186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.442672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ffa9a-73b3-4303-bb23-91a2eb9de4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd22b3cf9e04f2c9d13566f8285fd2e, user_id=dae68cfac68440b09a650d2b930935dc, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.445043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 954/1887] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:08.449484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.451730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ffa9a-73b3-4303-bb23-91a2eb9de4d0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.464112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0da39-8cb4-442d-80b6-1a25d09b8d06 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.470038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64709cd-e530-4e96-b87e-5ea71ceb755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.470233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64709cd-e530-4e96-b87e-5ea71ceb755a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.470489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64709cd-e530-4e96-b87e-5ea71ceb755a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.470768 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64709cd-e530-4e96-b87e-5ea71ceb755a admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.471460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64709cd-e530-4e96-b87e-5ea71ceb755a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.473436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64709cd-e530-4e96-b87e-5ea71ceb755a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.539581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 934/1888] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:08 2022] PUT /identity/v3/projects/dbd22b3cf9e04f2c9d13566f8285fd2e/users/dae68cfac68440b09a650d2b930935dc/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:08.544125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ffa9a-73b3-4303-bb23-91a2eb9de4d0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.569310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 955/1889] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:08 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:08.573456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64709cd-e530-4e96-b87e-5ea71ceb755a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.610709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ffa9a-73b3-4303-bb23-91a2eb9de4d0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.637656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64709cd-e530-4e96-b87e-5ea71ceb755a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.645085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4bcac-01f5-492b-aad8-c95656d720e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.645771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4bcac-01f5-492b-aad8-c95656d720e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.646078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4bcac-01f5-492b-aad8-c95656d720e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.646359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4bcac-01f5-492b-aad8-c95656d720e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.647717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4bcac-01f5-492b-aad8-c95656d720e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.649682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4bcac-01f5-492b-aad8-c95656d720e6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.671846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cddeb7-2485-49fd-8547-f8f499890073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.671995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cddeb7-2485-49fd-8547-f8f499890073 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.672255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cddeb7-2485-49fd-8547-f8f499890073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.672556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cddeb7-2485-49fd-8547-f8f499890073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.673234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cddeb7-2485-49fd-8547-f8f499890073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.674881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cddeb7-2485-49fd-8547-f8f499890073 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.686869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 935/1890] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:08.691321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cddeb7-2485-49fd-8547-f8f499890073 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.703452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cddeb7-2485-49fd-8547-f8f499890073 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.709582 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c4333-e5f1-474b-b5a5-3db52c774bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.710674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c4333-e5f1-474b-b5a5-3db52c774bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.711252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c4333-e5f1-474b-b5a5-3db52c774bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.711496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c4333-e5f1-474b-b5a5-3db52c774bcc admin admin] PATH_INFO: `/v3/projects/dbd22b3cf9e04f2c9d13566f8285fd2e/users/dae68cfac68440b09a650d2b930935dc/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.713561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c4333-e5f1-474b-b5a5-3db52c774bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd22b3cf9e04f2c9d13566f8285fd2e, user_id=dae68cfac68440b09a650d2b930935dc, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.716682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c4333-e5f1-474b-b5a5-3db52c774bcc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.730601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 936/1891] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:08 2022] PUT /identity/v3/projects/dbd22b3cf9e04f2c9d13566f8285fd2e/users/dae68cfac68440b09a650d2b930935dc/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:08.742500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75913b-4e28-44b4-a722-f3e6b50e472a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.742945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75913b-4e28-44b4-a722-f3e6b50e472a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.743553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75913b-4e28-44b4-a722-f3e6b50e472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.793337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ac75913b-4e28-44b4-a722-f3e6b50e472a None None] MFA Rules not processed for user `dae68cfac68440b09a650d2b930935dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:08.794624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ac75913b-4e28-44b4-a722-f3e6b50e472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:08.802634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 956/1892] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:08 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:08.806381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4bcac-01f5-492b-aad8-c95656d720e6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.818894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:08.823578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4bcac-01f5-492b-aad8-c95656d720e6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.896180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad81d50-6211-4deb-bdbc-4c4df5071877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.897217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad81d50-6211-4deb-bdbc-4c4df5071877 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.904050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad81d50-6211-4deb-bdbc-4c4df5071877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.904050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad81d50-6211-4deb-bdbc-4c4df5071877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.904275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 937/1893] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:08.912660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad81d50-6211-4deb-bdbc-4c4df5071877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.915212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad81d50-6211-4deb-bdbc-4c4df5071877 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.920921 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75913b-4e28-44b4-a722-f3e6b50e472a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.922945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ac75913b-4e28-44b4-a722-f3e6b50e472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:08.929757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 957/1894] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:08.934809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad81d50-6211-4deb-bdbc-4c4df5071877 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:08.952958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad81d50-6211-4deb-bdbc-4c4df5071877 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:08.966702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb0e98-00aa-448a-91bc-866b01505d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:08.966702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb0e98-00aa-448a-91bc-866b01505d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:08.967043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb0e98-00aa-448a-91bc-866b01505d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:08.968165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb0e98-00aa-448a-91bc-866b01505d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:08.969039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb0e98-00aa-448a-91bc-866b01505d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:08.970772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb0e98-00aa-448a-91bc-866b01505d22 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:08.997382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 958/1895] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:09.002217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb0e98-00aa-448a-91bc-866b01505d22 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:09.015806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75913b-4e28-44b4-a722-f3e6b50e472a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:09.016008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb0e98-00aa-448a-91bc-866b01505d22 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:09.020086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca661d-69fd-451b-8121-cd99b3afae8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:09.020799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca661d-69fd-451b-8121-cd99b3afae8a service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:09.021077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca661d-69fd-451b-8121-cd99b3afae8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:09.021528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca661d-69fd-451b-8121-cd99b3afae8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:09.022134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73c5ec-2d54-4c66-ac1a-62011bf793fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:09.022954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73c5ec-2d54-4c66-ac1a-62011bf793fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:09.023242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73c5ec-2d54-4c66-ac1a-62011bf793fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:09.023524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73c5ec-2d54-4c66-ac1a-62011bf793fb admin admin] PATH_INFO: `/v3/projects/cb60fb62c3a5459e876f95cadef248f3/users/87e27cf8d0e54bc3a2f8563a1e8ff6b7/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:09.031204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca661d-69fd-451b-8121-cd99b3afae8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:09.032691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca661d-69fd-451b-8121-cd99b3afae8a service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:09.041311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73c5ec-2d54-4c66-ac1a-62011bf793fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb60fb62c3a5459e876f95cadef248f3, user_id=87e27cf8d0e54bc3a2f8563a1e8ff6b7, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:09.043962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73c5ec-2d54-4c66-ac1a-62011bf793fb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:09.044281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 938/1896] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:09.116453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 959/1897] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:09 2022] PUT /identity/v3/projects/cb60fb62c3a5459e876f95cadef248f3/users/87e27cf8d0e54bc3a2f8563a1e8ff6b7/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:09.132795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c6ff1-25b9-45b2-a336-db91b742a496 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:09.133266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c6ff1-25b9-45b2-a336-db91b742a496 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:09.133707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c6ff1-25b9-45b2-a336-db91b742a496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:09.167922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5e9c6ff1-25b9-45b2-a336-db91b742a496 None None] MFA Rules not processed for user `87e27cf8d0e54bc3a2f8563a1e8ff6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:09.169406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5e9c6ff1-25b9-45b2-a336-db91b742a496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:09.243391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 939/1898] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:09.247727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73c5ec-2d54-4c66-ac1a-62011bf793fb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:09.338056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73c5ec-2d54-4c66-ac1a-62011bf793fb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:09.342893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104e231-1de1-4ebe-be1b-c043bc729c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:09.343589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e231-1de1-4ebe-be1b-c043bc729c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:09.343944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e231-1de1-4ebe-be1b-c043bc729c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:09.344314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e231-1de1-4ebe-be1b-c043bc729c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:09.345186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104e231-1de1-4ebe-be1b-c043bc729c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:09.347270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104e231-1de1-4ebe-be1b-c043bc729c4f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:09.456650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 960/1899] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:09 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:09.458506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c6ff1-25b9-45b2-a336-db91b742a496 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:09.472134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c6ff1-25b9-45b2-a336-db91b742a496 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:09.556656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:09.576638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2f01-8136-4aa1-802e-cb7ff9f8ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:09.577680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2f01-8136-4aa1-802e-cb7ff9f8ea12 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:09.585986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2f01-8136-4aa1-802e-cb7ff9f8ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:09.585986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2f01-8136-4aa1-802e-cb7ff9f8ea12 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:09.585986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b2f01-8136-4aa1-802e-cb7ff9f8ea12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:09.585986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b2f01-8136-4aa1-802e-cb7ff9f8ea12 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:09.710537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 940/1900] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:09 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:09.717615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104e231-1de1-4ebe-be1b-c043bc729c4f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:09.728087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104e231-1de1-4ebe-be1b-c043bc729c4f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:09.732873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dd720-6751-4852-b199-1c02313b3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:09.733482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dd720-6751-4852-b199-1c02313b3d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:09.733760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dd720-6751-4852-b199-1c02313b3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:09.734032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dd720-6751-4852-b199-1c02313b3d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:09.734679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dd720-6751-4852-b199-1c02313b3d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:09.736286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dd720-6751-4852-b199-1c02313b3d0d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:09.759144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 961/1901] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:09.760454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2f01-8136-4aa1-802e-cb7ff9f8ea12 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:09.771905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2f01-8136-4aa1-802e-cb7ff9f8ea12 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:09.776804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb174498-298e-4f50-9420-42a847c9fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:09.777517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174498-298e-4f50-9420-42a847c9fc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:09.777798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174498-298e-4f50-9420-42a847c9fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:09.778369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb174498-298e-4f50-9420-42a847c9fc87 admin admin] PATH_INFO: `/v3/projects/cdc6f579a63d458eb4298f9d19a1a04b/users/d73f785f14c0482ea642990872bdbdc0/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:09.795591 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb174498-298e-4f50-9420-42a847c9fc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc6f579a63d458eb4298f9d19a1a04b, user_id=d73f785f14c0482ea642990872bdbdc0, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:09.798962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb174498-298e-4f50-9420-42a847c9fc87 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:09.893080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 941/1902] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:09 2022] PUT /identity/v3/projects/cdc6f579a63d458eb4298f9d19a1a04b/users/d73f785f14c0482ea642990872bdbdc0/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:09.897178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dd720-6751-4852-b199-1c02313b3d0d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:09.907857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dd720-6751-4852-b199-1c02313b3d0d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:09.949686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:09.965992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a41a39-572c-44a4-8f1e-b5f5a9c456f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:09.966609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a41a39-572c-44a4-8f1e-b5f5a9c456f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:09.966922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a41a39-572c-44a4-8f1e-b5f5a9c456f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:09.967195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a41a39-572c-44a4-8f1e-b5f5a9c456f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:09.967847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a41a39-572c-44a4-8f1e-b5f5a9c456f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:09.969468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a41a39-572c-44a4-8f1e-b5f5a9c456f9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:09.984332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 962/1903] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:09.985314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb174498-298e-4f50-9420-42a847c9fc87 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:09.996973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb174498-298e-4f50-9420-42a847c9fc87 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:10.002030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d92dc-ce04-4fa3-88d0-d50d01192e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:10.004233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d92dc-ce04-4fa3-88d0-d50d01192e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:10.004233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d92dc-ce04-4fa3-88d0-d50d01192e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:10.004233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d92dc-ce04-4fa3-88d0-d50d01192e74 admin admin] PATH_INFO: `/v3/projects/cdc6f579a63d458eb4298f9d19a1a04b/users/d73f785f14c0482ea642990872bdbdc0/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:10.005903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d92dc-ce04-4fa3-88d0-d50d01192e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc6f579a63d458eb4298f9d19a1a04b, user_id=d73f785f14c0482ea642990872bdbdc0, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:10.008690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d92dc-ce04-4fa3-88d0-d50d01192e74 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:10.020689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 942/1904] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:09 2022] PUT /identity/v3/projects/cdc6f579a63d458eb4298f9d19a1a04b/users/d73f785f14c0482ea642990872bdbdc0/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:10.034653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba34d9-76fa-42f3-b154-58ab0c60649e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:10.034653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba34d9-76fa-42f3-b154-58ab0c60649e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:10.034653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba34d9-76fa-42f3-b154-58ab0c60649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:10.061195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-60ba34d9-76fa-42f3-b154-58ab0c60649e None None] MFA Rules not processed for user `d73f785f14c0482ea642990872bdbdc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:10.062708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-60ba34d9-76fa-42f3-b154-58ab0c60649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:10.158682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 963/1905] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:10.174283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d92dc-ce04-4fa3-88d0-d50d01192e74 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:10.272893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d92dc-ce04-4fa3-88d0-d50d01192e74 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:10.276732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7f3e-0d5d-4b12-89a6-b7ffc0ba2867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:10.277354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7f3e-0d5d-4b12-89a6-b7ffc0ba2867 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:10.277631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7f3e-0d5d-4b12-89a6-b7ffc0ba2867 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:10.277907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7f3e-0d5d-4b12-89a6-b7ffc0ba2867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:10.287891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7f3e-0d5d-4b12-89a6-b7ffc0ba2867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:10.289368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7f3e-0d5d-4b12-89a6-b7ffc0ba2867 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:10.299660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 943/1906] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:10.405915 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba34d9-76fa-42f3-b154-58ab0c60649e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:10.416157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba34d9-76fa-42f3-b154-58ab0c60649e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:10.419783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05a6ac-a849-4a1c-86d1-3b3de319f39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:10.420444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05a6ac-a849-4a1c-86d1-3b3de319f39a service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:10.420725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05a6ac-a849-4a1c-86d1-3b3de319f39a service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:10.420999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05a6ac-a849-4a1c-86d1-3b3de319f39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:10.422877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dc05a6ac-a849-4a1c-86d1-3b3de319f39a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:10.499164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05a6ac-a849-4a1c-86d1-3b3de319f39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:10.500683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05a6ac-a849-4a1c-86d1-3b3de319f39a service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:10.511484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 964/1907] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:11.704009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:12.126825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:12.128179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7f3e-0d5d-4b12-89a6-b7ffc0ba2867 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:12.216498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7f3e-0d5d-4b12-89a6-b7ffc0ba2867 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:12.222151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:12.223389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:12.225298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:12.225617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] PATH_INFO: `/v3/users/87e27cf8d0e54bc3a2f8563a1e8ff6b7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:12.226909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e27cf8d0e54bc3a2f8563a1e8ff6b7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:12.228953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:12.449856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e27cf8d0e54bc3a2f8563a1e8ff6b7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:12.459371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e27cf8d0e54bc3a2f8563a1e8ff6b7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:12.568339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e27cf8d0e54bc3a2f8563a1e8ff6b7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:12.583668 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e27cf8d0e54bc3a2f8563a1e8ff6b7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:12.584674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e27cf8d0e54bc3a2f8563a1e8ff6b7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:12.594315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 944/1908] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:12 2022] DELETE /identity/v3/users/87e27cf8d0e54bc3a2f8563a1e8ff6b7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:12.595830 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968fd46-64c8-4410-b7b1-4779e20b53a0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:12.596117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968fd46-64c8-4410-b7b1-4779e20b53a0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:12.596416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968fd46-64c8-4410-b7b1-4779e20b53a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:12.619591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9968fd46-64c8-4410-b7b1-4779e20b53a0 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:12.623304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9968fd46-64c8-4410-b7b1-4779e20b53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:12.688159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 965/1909] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:12.698563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:12.700030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:12.765778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caec15-2e3d-4d12-917a-2bb4b18c06f1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:12.770042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a9e60-1340-4dcb-810d-fe9186ccac9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:12.770672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a9e60-1340-4dcb-810d-fe9186ccac9b service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:12.771014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a9e60-1340-4dcb-810d-fe9186ccac9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:12.772769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a9e60-1340-4dcb-810d-fe9186ccac9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:12.787020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a9e60-1340-4dcb-810d-fe9186ccac9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:12.789780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a9e60-1340-4dcb-810d-fe9186ccac9b service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:12.803732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 945/1910] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:12.910469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:12.986640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968fd46-64c8-4410-b7b1-4779e20b53a0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:12.988956 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9968fd46-64c8-4410-b7b1-4779e20b53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:13.001471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968fd46-64c8-4410-b7b1-4779e20b53a0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:13.007206 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:13.008123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:13.008996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:13.009325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] PATH_INFO: `/v3/users/384724e7ebbc45a99a944a8d21781340` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:13.010801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384724e7ebbc45a99a944a8d21781340)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:13.012939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:13.263045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384724e7ebbc45a99a944a8d21781340'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.284592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384724e7ebbc45a99a944a8d21781340'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.305580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384724e7ebbc45a99a944a8d21781340'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.380968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384724e7ebbc45a99a944a8d21781340'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.381472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384724e7ebbc45a99a944a8d21781340'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.389733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 966/1911] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:12 2022] DELETE /identity/v3/users/384724e7ebbc45a99a944a8d21781340 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:13.394636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dea75-0c58-4deb-8a6d-33090586c436 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:13.396044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dea75-0c58-4deb-8a6d-33090586c436 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:13.396384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dea75-0c58-4deb-8a6d-33090586c436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:13.415535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-614dea75-0c58-4deb-8a6d-33090586c436 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:13.416842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-614dea75-0c58-4deb-8a6d-33090586c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:13.490321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:13.491806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:13.500881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 946/1912] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:13.547594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dea75-0c58-4deb-8a6d-33090586c436 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:13.547594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-614dea75-0c58-4deb-8a6d-33090586c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:13.570416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb70e1-0229-48b0-b16c-4c07fb5d7f02 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:13.575686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:13.576352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:13.576661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:13.576937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] PATH_INFO: `/v3/projects/cb60fb62c3a5459e876f95cadef248f3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:13.578122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb60fb62c3a5459e876f95cadef248f3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:13.580059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:13.600960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dea75-0c58-4deb-8a6d-33090586c436 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:13.604533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893ac44-e98e-46e1-bafb-5ee8e0ae9b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:13.605157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ac44-e98e-46e1-bafb-5ee8e0ae9b8f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:13.605431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ac44-e98e-46e1-bafb-5ee8e0ae9b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:13.605700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893ac44-e98e-46e1-bafb-5ee8e0ae9b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:13.631270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893ac44-e98e-46e1-bafb-5ee8e0ae9b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:13.632803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893ac44-e98e-46e1-bafb-5ee8e0ae9b8f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:13.643033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 947/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:13.768535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb60fb62c3a5459e876f95cadef248f3', 'request_id': 'req-631a1dcc-db53-47d7-9029-9091e0214d5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.781705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb60fb62c3a5459e876f95cadef248f3', 'request_id': 'req-631a1dcc-db53-47d7-9029-9091e0214d5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.789571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb60fb62c3a5459e876f95cadef248f3', 'request_id': 'req-631a1dcc-db53-47d7-9029-9091e0214d5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.887636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:13.893161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] The token cache is being invalidate because project cb60fb62c3a5459e876f95cadef248f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:13.893462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.894267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:13.896054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 967/1914] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:13 2022] DELETE /identity/v3/projects/cb60fb62c3a5459e876f95cadef248f3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:13.900323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893ac44-e98e-46e1-bafb-5ee8e0ae9b8f service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:13.914901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893ac44-e98e-46e1-bafb-5ee8e0ae9b8f service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:14.072367 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:14.073026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:14.073316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:14.073572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] PATH_INFO: `/v3/users/d73f785f14c0482ea642990872bdbdc0` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:14.074729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73f785f14c0482ea642990872bdbdc0)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:14.076795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:14.305661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73f785f14c0482ea642990872bdbdc0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.312416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73f785f14c0482ea642990872bdbdc0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.345866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:14.348008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:14.361815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1dcc-db53-47d7-9029-9091e0214d5e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:14.368827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:14.369460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:14.370066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:14.370340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] PATH_INFO: `/v3/projects/3e10a8b64ad04a1e8847703f1be3dc60` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:14.371479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e10a8b64ad04a1e8847703f1be3dc60)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:14.373414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:14.414061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73f785f14c0482ea642990872bdbdc0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.425583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73f785f14c0482ea642990872bdbdc0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.426303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a77822f5-5e3f-47f0-bc3b-da1ddc15682a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73f785f14c0482ea642990872bdbdc0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.435431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 948/1915] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:13 2022] DELETE /identity/v3/users/d73f785f14c0482ea642990872bdbdc0 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:14.513731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e10a8b64ad04a1e8847703f1be3dc60', 'request_id': 'req-c1c17ad2-a759-4144-888a-bfe4283a3501'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.523017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e10a8b64ad04a1e8847703f1be3dc60', 'request_id': 'req-c1c17ad2-a759-4144-888a-bfe4283a3501'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.530397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e10a8b64ad04a1e8847703f1be3dc60', 'request_id': 'req-c1c17ad2-a759-4144-888a-bfe4283a3501'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.637477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] The token cache is being invalidate because project 3e10a8b64ad04a1e8847703f1be3dc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:14.637477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.637477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c1c17ad2-a759-4144-888a-bfe4283a3501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:14.639046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 968/1916] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:14 2022] DELETE /identity/v3/projects/3e10a8b64ad04a1e8847703f1be3dc60 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:14.644018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f554ec-bc63-44bd-8132-5b0cd222a4e2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:14.645178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f554ec-bc63-44bd-8132-5b0cd222a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:14.645457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f554ec-bc63-44bd-8132-5b0cd222a4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:14.666889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c3f554ec-bc63-44bd-8132-5b0cd222a4e2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:14.668205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c3f554ec-bc63-44bd-8132-5b0cd222a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:14.736959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 949/1917] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:14.745237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc945-fd8a-46b9-b326-67526abd4685 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:14.745898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc945-fd8a-46b9-b326-67526abd4685 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:14.746347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc945-fd8a-46b9-b326-67526abd4685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:14.753223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:14.772477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9aefc945-fd8a-46b9-b326-67526abd4685 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:14.773745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9aefc945-fd8a-46b9-b326-67526abd4685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:14.786127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 969/1918] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:14.790560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f554ec-bc63-44bd-8132-5b0cd222a4e2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:14.801571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f554ec-bc63-44bd-8132-5b0cd222a4e2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:14.806955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:14.807735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:14.810347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:14.810347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:14.810347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:14.810347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:14.810972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:14.824751 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 950/1919] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:26:14.829294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc945-fd8a-46b9-b326-67526abd4685 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:14.844851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc945-fd8a-46b9-b326-67526abd4685 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:14.850537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:14.851194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:14.851473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:14.851738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:14.852408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:14.854310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:14.969278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 970/1920] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:14 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:14.974230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:14.984692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf1054-b606-4030-b9d6-066aa76172fa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.021280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:15.023221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:15.048135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9642c-4c90-442f-9936-c08b356c579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.048815 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9642c-4c90-442f-9936-c08b356c579c admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.049095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9642c-4c90-442f-9936-c08b356c579c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.049372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9642c-4c90-442f-9936-c08b356c579c admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.050023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9642c-4c90-442f-9936-c08b356c579c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:15.052087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9642c-4c90-442f-9936-c08b356c579c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:15.109811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4822d42-cc86-4476-b0e2-b6f2a22c7c05 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.118632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.119309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.119608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.119856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] PATH_INFO: `/v3/projects/cdc6f579a63d458eb4298f9d19a1a04b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.121030 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc6f579a63d458eb4298f9d19a1a04b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:15.122987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:15.149574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 951/1921] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:14 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:15.150855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9642c-4c90-442f-9936-c08b356c579c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:15.161602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9642c-4c90-442f-9936-c08b356c579c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.166323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c37a7c-d43a-4749-98af-dcb6c3ee3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.170479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c37a7c-d43a-4749-98af-dcb6c3ee3404 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.170479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c37a7c-d43a-4749-98af-dcb6c3ee3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.170479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c37a7c-d43a-4749-98af-dcb6c3ee3404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.170479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c37a7c-d43a-4749-98af-dcb6c3ee3404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:15.170479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c37a7c-d43a-4749-98af-dcb6c3ee3404 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:15.184993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 952/1922] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:15.186293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c37a7c-d43a-4749-98af-dcb6c3ee3404 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:15.203932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c37a7c-d43a-4749-98af-dcb6c3ee3404 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.211789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5830-32cd-4d20-83a9-434fecc9835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.212509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5830-32cd-4d20-83a9-434fecc9835b admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.212793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5830-32cd-4d20-83a9-434fecc9835b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.213068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5830-32cd-4d20-83a9-434fecc9835b admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.213726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5830-32cd-4d20-83a9-434fecc9835b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:15.215659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5830-32cd-4d20-83a9-434fecc9835b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:15.228138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 953/1923] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:15.232937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5830-32cd-4d20-83a9-434fecc9835b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:15.256028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5830-32cd-4d20-83a9-434fecc9835b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.266380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc6f579a63d458eb4298f9d19a1a04b', 'request_id': 'req-247c04f8-41aa-4ef8-ac43-dff607459e8e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:15.274332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc6f579a63d458eb4298f9d19a1a04b', 'request_id': 'req-247c04f8-41aa-4ef8-ac43-dff607459e8e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:15.281014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc6f579a63d458eb4298f9d19a1a04b', 'request_id': 'req-247c04f8-41aa-4ef8-ac43-dff607459e8e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:15.328344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a15ab-7002-4909-9ae5-6fe5c00457de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.328723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a15ab-7002-4909-9ae5-6fe5c00457de admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.328926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a15ab-7002-4909-9ae5-6fe5c00457de admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.329201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a15ab-7002-4909-9ae5-6fe5c00457de admin admin] PATH_INFO: `/v3/projects/51191f32d7a542789f059c39169a1e35/users/c1571f1180dc4d178e2ffe7a410867f7/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.346055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a15ab-7002-4909-9ae5-6fe5c00457de admin admin] RBAC: Authorizing `identity:create_grant(project_id=51191f32d7a542789f059c39169a1e35, user_id=c1571f1180dc4d178e2ffe7a410867f7, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:15.350322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a15ab-7002-4909-9ae5-6fe5c00457de admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:15.379169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] The token cache is being invalidate because project cdc6f579a63d458eb4298f9d19a1a04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:15.380469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:15.389227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-247c04f8-41aa-4ef8-ac43-dff607459e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:15.389227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 971/1924] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:15 2022] DELETE /identity/v3/projects/cdc6f579a63d458eb4298f9d19a1a04b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:15.389469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3254c-81c9-47b4-82a9-15f21e7e5dd3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.389768 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3254c-81c9-47b4-82a9-15f21e7e5dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.390307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3254c-81c9-47b4-82a9-15f21e7e5dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.413364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3fb3254c-81c9-47b4-82a9-15f21e7e5dd3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:15.414987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3fb3254c-81c9-47b4-82a9-15f21e7e5dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:15.424183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 972/1925] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:15.433307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935c06-9db6-4cdf-a829-a4a90b2bb972 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.433668 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935c06-9db6-4cdf-a829-a4a90b2bb972 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.434014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88935c06-9db6-4cdf-a829-a4a90b2bb972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.463808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 954/1926] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:15 2022] PUT /identity/v3/projects/51191f32d7a542789f059c39169a1e35/users/c1571f1180dc4d178e2ffe7a410867f7/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:15.478674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1371b6-e534-4172-a91a-e3b1198c836a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.479321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1371b6-e534-4172-a91a-e3b1198c836a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.479827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1371b6-e534-4172-a91a-e3b1198c836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.489555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-88935c06-9db6-4cdf-a829-a4a90b2bb972 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:15.493573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-88935c06-9db6-4cdf-a829-a4a90b2bb972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:15.532799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fb1371b6-e534-4172-a91a-e3b1198c836a None None] MFA Rules not processed for user `c1571f1180dc4d178e2ffe7a410867f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:15.534501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fb1371b6-e534-4172-a91a-e3b1198c836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:15.622307 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:15.657962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 973/1927] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:15.658889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935c06-9db6-4cdf-a829-a4a90b2bb972 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:15.668446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 955/1928] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:15.683493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88935c06-9db6-4cdf-a829-a4a90b2bb972 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.693620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.696781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.696781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.696781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.696781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:15.696781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:15.697687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:15.714091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 974/1929] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:15.715450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:15.723929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1371b6-e534-4172-a91a-e3b1198c836a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:15.744560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1371b6-e534-4172-a91a-e3b1198c836a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.755556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70a727-0811-409e-a892-d5b479be2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.756189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70a727-0811-409e-a892-d5b479be2415 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.756543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70a727-0811-409e-a892-d5b479be2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.756830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70a727-0811-409e-a892-d5b479be2415 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.757484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70a727-0811-409e-a892-d5b479be2415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:15.759480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70a727-0811-409e-a892-d5b479be2415 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:15.813980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:15.816667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:15.864850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 956/1930] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:15 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:15.868153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70a727-0811-409e-a892-d5b479be2415 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:15.915663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d368ee-0d86-4218-b806-4aa4047db4e6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.950364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70a727-0811-409e-a892-d5b479be2415 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:15.963859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.965183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.965770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.966146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:15.966879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:15.969442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:15.974679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5d218-8182-4b72-a3e9-503851fdb675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:15.975354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5d218-8182-4b72-a3e9-503851fdb675 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:15.975641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5d218-8182-4b72-a3e9-503851fdb675 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:15.975919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5d218-8182-4b72-a3e9-503851fdb675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.083998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5d218-8182-4b72-a3e9-503851fdb675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.085752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5d218-8182-4b72-a3e9-503851fdb675 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:16.102993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 975/1931] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:16.105491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 957/1932] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:15 2022] POST /identity/v3/users => generated 282 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:16.117457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5d218-8182-4b72-a3e9-503851fdb675 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:16.119025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:16.121095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:16.130655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5d218-8182-4b72-a3e9-503851fdb675 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:16.135551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ce25-6d1a-488f-8509-721328d3c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:16.136433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ce25-6d1a-488f-8509-721328d3c7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.136554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ce25-6d1a-488f-8509-721328d3c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.137698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ce25-6d1a-488f-8509-721328d3c7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.138002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ce25-6d1a-488f-8509-721328d3c7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.140530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ce25-6d1a-488f-8509-721328d3c7ac admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:16.147834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd731260-bb64-4be8-be2d-9dd4d8357ec2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:16.159834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 976/1933] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:16.160978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ce25-6d1a-488f-8509-721328d3c7ac admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:16.164031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:16.165063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.165437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.166239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] PATH_INFO: `/v3/users/c1571f1180dc4d178e2ffe7a410867f7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.167351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1571f1180dc4d178e2ffe7a410867f7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.169804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:16.181786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ce25-6d1a-488f-8509-721328d3c7ac admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:16.187846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:16.193167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07335e9-0b72-412d-b77c-a264b09f8085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:16.193851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07335e9-0b72-412d-b77c-a264b09f8085 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.195034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07335e9-0b72-412d-b77c-a264b09f8085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.195034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07335e9-0b72-412d-b77c-a264b09f8085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.195034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07335e9-0b72-412d-b77c-a264b09f8085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.199192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07335e9-0b72-412d-b77c-a264b09f8085 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:16.232654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 977/1934] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:16.233493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07335e9-0b72-412d-b77c-a264b09f8085 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:16.254616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07335e9-0b72-412d-b77c-a264b09f8085 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:16.261562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33bc2f-381c-488d-98f2-db36dd914776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:16.262312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bc2f-381c-488d-98f2-db36dd914776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.262586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bc2f-381c-488d-98f2-db36dd914776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.262866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33bc2f-381c-488d-98f2-db36dd914776 admin admin] PATH_INFO: `/v3/projects/3298a99fc38742d9bd07b5ef2e6312ad/users/897871ccdaf7415292a859b2c460fe54/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.283030 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33bc2f-381c-488d-98f2-db36dd914776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3298a99fc38742d9bd07b5ef2e6312ad, user_id=897871ccdaf7415292a859b2c460fe54, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.286427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33bc2f-381c-488d-98f2-db36dd914776 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:16.359786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1571f1180dc4d178e2ffe7a410867f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:16.368420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 978/1935] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:16 2022] PUT /identity/v3/projects/3298a99fc38742d9bd07b5ef2e6312ad/users/897871ccdaf7415292a859b2c460fe54/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:16.369651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33bc2f-381c-488d-98f2-db36dd914776 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:16.388767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1571f1180dc4d178e2ffe7a410867f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:16.441131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33bc2f-381c-488d-98f2-db36dd914776 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:16.446477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1571f1180dc4d178e2ffe7a410867f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:16.452313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82405-ae54-4001-be5a-5798929887bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:16.453259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82405-ae54-4001-be5a-5798929887bf service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.453547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82405-ae54-4001-be5a-5798929887bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.453834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82405-ae54-4001-be5a-5798929887bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.456381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dff82405-ae54-4001-be5a-5798929887bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:16.464805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1571f1180dc4d178e2ffe7a410867f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:16.466689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c363eb5c-32a7-4c11-a429-0c1db4a749d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1571f1180dc4d178e2ffe7a410867f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:16.476020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 958/1936] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:16 2022] DELETE /identity/v3/users/c1571f1180dc4d178e2ffe7a410867f7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:16.478013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ea826-8a14-4607-960f-41605cf9120f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.478485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ea826-8a14-4607-960f-41605cf9120f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.479084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ea826-8a14-4607-960f-41605cf9120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.529520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82405-ae54-4001-be5a-5798929887bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.532105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82405-ae54-4001-be5a-5798929887bf service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:16.538883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e47ea826-8a14-4607-960f-41605cf9120f None None] MFA Rules not processed for user `897871ccdaf7415292a859b2c460fe54`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:16.540098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e47ea826-8a14-4607-960f-41605cf9120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:16.543051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 979/1937] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:16.544356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4d21-3aac-4e48-a129-65bb3aa628f3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.544652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4d21-3aac-4e48-a129-65bb3aa628f3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.544931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4d21-3aac-4e48-a129-65bb3aa628f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.565710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0dff4d21-3aac-4e48-a129-65bb3aa628f3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:16.568698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0dff4d21-3aac-4e48-a129-65bb3aa628f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:16.699150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 959/1938] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:16.700430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ea826-8a14-4607-960f-41605cf9120f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:16.702853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e47ea826-8a14-4607-960f-41605cf9120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:16.722857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:16.735115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 980/1939] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:16.773861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff4d21-3aac-4e48-a129-65bb3aa628f3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:16.776158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0dff4d21-3aac-4e48-a129-65bb3aa628f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:16.795361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ea826-8a14-4607-960f-41605cf9120f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:16.801723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3af53-c045-4ad7-95a9-383361760f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:16.802549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3af53-c045-4ad7-95a9-383361760f0f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.802895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3af53-c045-4ad7-95a9-383361760f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.803084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3af53-c045-4ad7-95a9-383361760f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.803724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3af53-c045-4ad7-95a9-383361760f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.805692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3af53-c045-4ad7-95a9-383361760f0f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:16.868966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff4d21-3aac-4e48-a129-65bb3aa628f3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:16.872863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690553ed-54da-40e3-907d-935d14cfa549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:16.873510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690553ed-54da-40e3-907d-935d14cfa549 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.873803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690553ed-54da-40e3-907d-935d14cfa549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.874085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690553ed-54da-40e3-907d-935d14cfa549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.895082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 960/1940] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:16 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:16.897066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690553ed-54da-40e3-907d-935d14cfa549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.898893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3af53-c045-4ad7-95a9-383361760f0f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:16.899037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690553ed-54da-40e3-907d-935d14cfa549 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:16.913504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 981/1941] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:16.988855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3af53-c045-4ad7-95a9-383361760f0f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:16.994216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562c813-3790-460c-bb23-a122265a3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:16.994855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c813-3790-460c-bb23-a122265a3c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:16.995160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c813-3790-460c-bb23-a122265a3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:16.995437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562c813-3790-460c-bb23-a122265a3c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:16.996101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562c813-3790-460c-bb23-a122265a3c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:16.999541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562c813-3790-460c-bb23-a122265a3c0b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:17.088242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 961/1942] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:16 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:17.091662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690553ed-54da-40e3-907d-935d14cfa549 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:17.128196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690553ed-54da-40e3-907d-935d14cfa549 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:17.139483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e6503-080a-4070-974e-b9dbcbf25ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:17.141014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e6503-080a-4070-974e-b9dbcbf25ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:17.141404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e6503-080a-4070-974e-b9dbcbf25ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:17.141805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e6503-080a-4070-974e-b9dbcbf25ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:17.143588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e6503-080a-4070-974e-b9dbcbf25ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:17.150209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e6503-080a-4070-974e-b9dbcbf25ab8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:17.184392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 982/1943] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:17.188173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562c813-3790-460c-bb23-a122265a3c0b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:17.201717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562c813-3790-460c-bb23-a122265a3c0b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:17.207410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc30f-04c4-44aa-b6ed-ff3f11ac9c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:17.208214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc30f-04c4-44aa-b6ed-ff3f11ac9c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:17.208595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc30f-04c4-44aa-b6ed-ff3f11ac9c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:17.209070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dc30f-04c4-44aa-b6ed-ff3f11ac9c4f admin admin] PATH_INFO: `/v3/projects/8c845921592442728037ec0d55e758d8/users/d25f5a6017bd41e8b79ccf2be38491c3/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:17.233898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dc30f-04c4-44aa-b6ed-ff3f11ac9c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c845921592442728037ec0d55e758d8, user_id=d25f5a6017bd41e8b79ccf2be38491c3, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:17.236942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dc30f-04c4-44aa-b6ed-ff3f11ac9c4f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:17.337086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 962/1944] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:17 2022] PUT /identity/v3/projects/8c845921592442728037ec0d55e758d8/users/d25f5a6017bd41e8b79ccf2be38491c3/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:17.341173 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e6503-080a-4070-974e-b9dbcbf25ab8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:17.352147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e6503-080a-4070-974e-b9dbcbf25ab8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:17.433521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6433b23-078c-49f3-8c80-7fb54ce5b962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:17.434163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433b23-078c-49f3-8c80-7fb54ce5b962 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:17.434861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433b23-078c-49f3-8c80-7fb54ce5b962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:17.434861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433b23-078c-49f3-8c80-7fb54ce5b962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:17.435487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6433b23-078c-49f3-8c80-7fb54ce5b962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:17.437735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6433b23-078c-49f3-8c80-7fb54ce5b962 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:17.450103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 983/1945] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:17.455181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc30f-04c4-44aa-b6ed-ff3f11ac9c4f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:17.468710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dc30f-04c4-44aa-b6ed-ff3f11ac9c4f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:17.481552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:17.481552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:17.481552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:17.481552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] PATH_INFO: `/v3/projects/8c845921592442728037ec0d55e758d8/users/d25f5a6017bd41e8b79ccf2be38491c3/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:17.481951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c845921592442728037ec0d55e758d8, user_id=d25f5a6017bd41e8b79ccf2be38491c3, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:17.481951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:17.496887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 963/1946] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:17 2022] PUT /identity/v3/projects/8c845921592442728037ec0d55e758d8/users/d25f5a6017bd41e8b79ccf2be38491c3/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:17.513715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63bad-b15a-451e-9a42-fa5bb7752c6f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:17.513715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63bad-b15a-451e-9a42-fa5bb7752c6f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:17.513715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63bad-b15a-451e-9a42-fa5bb7752c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:17.562467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-38d63bad-b15a-451e-9a42-fa5bb7752c6f None None] MFA Rules not processed for user `d25f5a6017bd41e8b79ccf2be38491c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:17.563719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-38d63bad-b15a-451e-9a42-fa5bb7752c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:17.680740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 984/1947] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:17.685787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:17.688254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:17.699034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:17.781577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da40a-043e-41a3-8168-308a4c5e66f9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:17.787267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f2464-248f-4769-9b63-c8fd87bfbe8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:17.790114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f2464-248f-4769-9b63-c8fd87bfbe8f service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:17.790375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f2464-248f-4769-9b63-c8fd87bfbe8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:17.790653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f2464-248f-4769-9b63-c8fd87bfbe8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:17.812949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f2464-248f-4769-9b63-c8fd87bfbe8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:17.814429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f2464-248f-4769-9b63-c8fd87bfbe8f service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:17.851698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 964/1948] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:17.895301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d63bad-b15a-451e-9a42-fa5bb7752c6f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:17.897295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-38d63bad-b15a-451e-9a42-fa5bb7752c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:17.929084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:17.992718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d63bad-b15a-451e-9a42-fa5bb7752c6f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:17.999043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:17.999695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:17.999978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:18.000329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] PATH_INFO: `/v3/projects/51191f32d7a542789f059c39169a1e35` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:18.001576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51191f32d7a542789f059c39169a1e35)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:18.003603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:18.117178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f2464-248f-4769-9b63-c8fd87bfbe8f service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:18.132003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f2464-248f-4769-9b63-c8fd87bfbe8f service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:18.161931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51191f32d7a542789f059c39169a1e35', 'request_id': 'req-2ccce4b6-704b-43e0-836e-e0e5c89ed767'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:18.170841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51191f32d7a542789f059c39169a1e35', 'request_id': 'req-2ccce4b6-704b-43e0-836e-e0e5c89ed767'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:18.182499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51191f32d7a542789f059c39169a1e35', 'request_id': 'req-2ccce4b6-704b-43e0-836e-e0e5c89ed767'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:18.211581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72df90-d191-40b0-84c4-6b9c0728ab70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:18.212378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72df90-d191-40b0-84c4-6b9c0728ab70 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:18.212733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72df90-d191-40b0-84c4-6b9c0728ab70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:18.213073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72df90-d191-40b0-84c4-6b9c0728ab70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:18.282225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] The token cache is being invalidate because project 51191f32d7a542789f059c39169a1e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:18.284416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:18.287422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2ccce4b6-704b-43e0-836e-e0e5c89ed767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:18.290275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 985/1949] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:17 2022] DELETE /identity/v3/projects/51191f32d7a542789f059c39169a1e35 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:18.294811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c730cf-97b0-4762-8904-0f2bd618840c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:18.295104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c730cf-97b0-4762-8904-0f2bd618840c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:18.295383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c730cf-97b0-4762-8904-0f2bd618840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:18.324275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-25c730cf-97b0-4762-8904-0f2bd618840c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:18.327021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-25c730cf-97b0-4762-8904-0f2bd618840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:18.330391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72df90-d191-40b0-84c4-6b9c0728ab70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:18.340172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72df90-d191-40b0-84c4-6b9c0728ab70 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:18.410542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 965/1950] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:18.469856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 986/1951] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:18.474020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991be2d-f31a-4570-a293-f9893a349052 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:18.474830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991be2d-f31a-4570-a293-f9893a349052 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:18.475319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991be2d-f31a-4570-a293-f9893a349052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:18.520598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2991be2d-f31a-4570-a293-f9893a349052 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:18.523630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2991be2d-f31a-4570-a293-f9893a349052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:18.541507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c730cf-97b0-4762-8904-0f2bd618840c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:18.542627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 966/1952] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:18.566414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c730cf-97b0-4762-8904-0f2bd618840c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:18.572752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:18.573375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:18.573655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:18.573930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:18.574590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:18.574894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:18.576511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:18.611352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 987/1953] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:26:18.612582 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991be2d-f31a-4570-a293-f9893a349052 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:18.633511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991be2d-f31a-4570-a293-f9893a349052 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:18.639472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7843d-2226-4947-8023-cfdd386b7ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:18.640260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7843d-2226-4947-8023-cfdd386b7ebe admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:18.640686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7843d-2226-4947-8023-cfdd386b7ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:18.641081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7843d-2226-4947-8023-cfdd386b7ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:18.641960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7843d-2226-4947-8023-cfdd386b7ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:18.644391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7843d-2226-4947-8023-cfdd386b7ebe admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:18.829085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 967/1954] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:18 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:18.833370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:18.849754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0fa54-267f-4b3a-8841-9ae93e239a99 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:19.010062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4db3e-5ea5-4e7b-96f8-63ba065f172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:19.010544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4db3e-5ea5-4e7b-96f8-63ba065f172e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:19.010839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4db3e-5ea5-4e7b-96f8-63ba065f172e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:19.011144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4db3e-5ea5-4e7b-96f8-63ba065f172e admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:19.011964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4db3e-5ea5-4e7b-96f8-63ba065f172e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:19.015466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4db3e-5ea5-4e7b-96f8-63ba065f172e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:19.159002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 988/1955] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:18 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:19.163902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7843d-2226-4947-8023-cfdd386b7ebe admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:19.181426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7843d-2226-4947-8023-cfdd386b7ebe admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:19.203137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f391588-f25b-4ddd-92b6-53d2aec2c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:19.205090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f391588-f25b-4ddd-92b6-53d2aec2c29c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:19.206164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f391588-f25b-4ddd-92b6-53d2aec2c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:19.206968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f391588-f25b-4ddd-92b6-53d2aec2c29c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:19.208121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f391588-f25b-4ddd-92b6-53d2aec2c29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:19.217372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f391588-f25b-4ddd-92b6-53d2aec2c29c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:19.251900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 968/1956] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:19.253661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4db3e-5ea5-4e7b-96f8-63ba065f172e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:19.270371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:19.279769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4db3e-5ea5-4e7b-96f8-63ba065f172e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:19.297836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea7970-889d-41ea-a6fc-cf4c28578dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:19.299211 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea7970-889d-41ea-a6fc-cf4c28578dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:19.299683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea7970-889d-41ea-a6fc-cf4c28578dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:19.301046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea7970-889d-41ea-a6fc-cf4c28578dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:19.305308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea7970-889d-41ea-a6fc-cf4c28578dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:19.308028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea7970-889d-41ea-a6fc-cf4c28578dcc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:19.330486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 989/1957] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:19.336330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f391588-f25b-4ddd-92b6-53d2aec2c29c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:19.350563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f391588-f25b-4ddd-92b6-53d2aec2c29c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:19.374335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:19.375204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:19.375585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:19.375966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] PATH_INFO: `/v3/projects/0af790060388467f9c75a0697e3b6b2d/users/e30d7fdb6e544767b8851e2af7ad682d/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:19.403493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af790060388467f9c75a0697e3b6b2d, user_id=e30d7fdb6e544767b8851e2af7ad682d, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:19.408106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:19.510305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 969/1958] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:19 2022] PUT /identity/v3/projects/0af790060388467f9c75a0697e3b6b2d/users/e30d7fdb6e544767b8851e2af7ad682d/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:19.515842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9bca-94fd-4427-b0a9-180280295d6d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:19.516449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9bca-94fd-4427-b0a9-180280295d6d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:19.516449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9bca-94fd-4427-b0a9-180280295d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:19.590131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3c3e9bca-94fd-4427-b0a9-180280295d6d None None] MFA Rules not processed for user `e30d7fdb6e544767b8851e2af7ad682d`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:19.598016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c3e9bca-94fd-4427-b0a9-180280295d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:19.704351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 990/1959] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:19.726633 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:19.728705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:19.907972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f56e2b-9099-4124-a292-4c5792b46c74 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:19.921155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c886c7-6fb2-45ae-a8bb-245f4e741bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:19.922347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c886c7-6fb2-45ae-a8bb-245f4e741bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:19.922684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c886c7-6fb2-45ae-a8bb-245f4e741bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:19.922961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c886c7-6fb2-45ae-a8bb-245f4e741bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:19.954142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c886c7-6fb2-45ae-a8bb-245f4e741bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:19.960564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c886c7-6fb2-45ae-a8bb-245f4e741bd5 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:19.990316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 970/1960] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:20.252921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:20.711667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:20.938516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:21.887220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:21.901348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9bca-94fd-4427-b0a9-180280295d6d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:21.902875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3c3e9bca-94fd-4427-b0a9-180280295d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:21.970086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9bca-94fd-4427-b0a9-180280295d6d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:21.975432 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:21.976084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:21.976381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:21.976661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] PATH_INFO: `/v3/users/c47f290e69f4460985c880867c44b711` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:21.977788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47f290e69f4460985c880867c44b711)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:21.979735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:22.169842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47f290e69f4460985c880867c44b711'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:22.177551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47f290e69f4460985c880867c44b711'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:22.197581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47f290e69f4460985c880867c44b711'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:22.275253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47f290e69f4460985c880867c44b711'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:22.276064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47f290e69f4460985c880867c44b711'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:22.285338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 991/1961] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:21 2022] DELETE /identity/v3/users/c47f290e69f4460985c880867c44b711 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:22.290611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3beea-00e1-402e-9e10-6cc92b3ae8f9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:22.291428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3beea-00e1-402e-9e10-6cc92b3ae8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:22.291845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3beea-00e1-402e-9e10-6cc92b3ae8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:22.322163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4ed3beea-00e1-402e-9e10-6cc92b3ae8f9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:22.323671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4ed3beea-00e1-402e-9e10-6cc92b3ae8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:22.361350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:22.411254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 971/1962] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:22.422381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:22.424159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:22.459156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:22.490819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d10cd-a117-4c10-8034-3f54ace641c4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:22.494436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc767335-f5da-4fd5-b37c-b148ea8e5fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:22.495177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc767335-f5da-4fd5-b37c-b148ea8e5fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:22.495320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc767335-f5da-4fd5-b37c-b148ea8e5fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:22.495594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc767335-f5da-4fd5-b37c-b148ea8e5fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:22.507744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc767335-f5da-4fd5-b37c-b148ea8e5fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:22.509513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc767335-f5da-4fd5-b37c-b148ea8e5fd1 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:22.521071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 992/1963] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:22.944262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:23.127070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3beea-00e1-402e-9e10-6cc92b3ae8f9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:23.129026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4ed3beea-00e1-402e-9e10-6cc92b3ae8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:23.154610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3beea-00e1-402e-9e10-6cc92b3ae8f9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:23.168080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:23.168789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:23.169071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:23.169346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] PATH_INFO: `/v3/projects/11a1e819a41845419bb013b24b091d5b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:23.171177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a1e819a41845419bb013b24b091d5b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:23.184267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:23.213817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:23.346807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a1e819a41845419bb013b24b091d5b', 'request_id': 'req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:23.469730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a1e819a41845419bb013b24b091d5b', 'request_id': 'req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:23.485960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a1e819a41845419bb013b24b091d5b', 'request_id': 'req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:23.502015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] The token cache is being invalidate because project 11a1e819a41845419bb013b24b091d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:23.502631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:23.504350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:23.506338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 972/1964] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:23 2022] DELETE /identity/v3/projects/11a1e819a41845419bb013b24b091d5b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:23.510258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc767335-f5da-4fd5-b37c-b148ea8e5fd1 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:23.521677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc767335-f5da-4fd5-b37c-b148ea8e5fd1 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:23.607941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:23.608616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:23.608961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:23.609387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] PATH_INFO: `/v3/users/4b3f1245382e47debd540f75f92ddffd` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:23.611042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3f1245382e47debd540f75f92ddffd)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:23.613472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:23.895316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:23.895625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3f1245382e47debd540f75f92ddffd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:23.916072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3f1245382e47debd540f75f92ddffd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:23.942997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3f1245382e47debd540f75f92ddffd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:24.024078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3f1245382e47debd540f75f92ddffd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:24.028984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3f1245382e47debd540f75f92ddffd'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:24.042524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 993/1965] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:23 2022] DELETE /identity/v3/users/4b3f1245382e47debd540f75f92ddffd => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:24.131839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:24.683134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:24.684802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:24.698783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac2931-8ac9-4ab5-aae4-c4c790e88453 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:24.765267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:24.765843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:24.766127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:24.766405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] PATH_INFO: `/v3/projects/82ad11ca2f5c43efa53cbf18a716e05e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:24.767614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ad11ca2f5c43efa53cbf18a716e05e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:24.771935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:24.868470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ad11ca2f5c43efa53cbf18a716e05e', 'request_id': 'req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:24.973008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ad11ca2f5c43efa53cbf18a716e05e', 'request_id': 'req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:24.981569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ad11ca2f5c43efa53cbf18a716e05e', 'request_id': 'req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:24.993329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] The token cache is being invalidate because project 82ad11ca2f5c43efa53cbf18a716e05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:24.993634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:24.994362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:24.995899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 973/1966] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:24 2022] DELETE /identity/v3/projects/82ad11ca2f5c43efa53cbf18a716e05e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:25.000825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:25.003487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:25.021239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6146135-7c56-4a38-ada3-0a2e614ed2d8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:25.081020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:25.094375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:25.095019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:25.095301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:25.095726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] PATH_INFO: `/v3/users/dae68cfac68440b09a650d2b930935dc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:25.097074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae68cfac68440b09a650d2b930935dc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:25.099086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:25.298402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae68cfac68440b09a650d2b930935dc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:25.308501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae68cfac68440b09a650d2b930935dc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:25.326754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae68cfac68440b09a650d2b930935dc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:25.390534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae68cfac68440b09a650d2b930935dc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:25.392042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b50d60b3-25cc-4423-9c2e-80b96bb27f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae68cfac68440b09a650d2b930935dc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:25.400572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 994/1967] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:24 2022] DELETE /identity/v3/users/dae68cfac68440b09a650d2b930935dc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:25.895701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:25.897269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:25.910058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b16288-1ff8-4de3-8f43-bb1b4f7fb938 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:25.984393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:25.993996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:25.994719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:25.995027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:25.995296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] PATH_INFO: `/v3/projects/dbd22b3cf9e04f2c9d13566f8285fd2e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:25.996511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd22b3cf9e04f2c9d13566f8285fd2e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:25.998618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:26.125600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd22b3cf9e04f2c9d13566f8285fd2e', 'request_id': 'req-1b681ea1-e22f-4239-8bfc-87069422899b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:26.235177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd22b3cf9e04f2c9d13566f8285fd2e', 'request_id': 'req-1b681ea1-e22f-4239-8bfc-87069422899b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:26.242647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd22b3cf9e04f2c9d13566f8285fd2e', 'request_id': 'req-1b681ea1-e22f-4239-8bfc-87069422899b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:26.254354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] The token cache is being invalidate because project dbd22b3cf9e04f2c9d13566f8285fd2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:26.254652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:26.255312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1b681ea1-e22f-4239-8bfc-87069422899b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:26.256853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 974/1968] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:25 2022] DELETE /identity/v3/projects/dbd22b3cf9e04f2c9d13566f8285fd2e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:26.262812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daea140-23c3-4acb-ad6c-07beec4d08cf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.263577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daea140-23c3-4acb-ad6c-07beec4d08cf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.263667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daea140-23c3-4acb-ad6c-07beec4d08cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.283849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0daea140-23c3-4acb-ad6c-07beec4d08cf None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:26.285113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0daea140-23c3-4acb-ad6c-07beec4d08cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:26.335373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:26.344165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 995/1969] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:26.354280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072098-c13d-49db-b6a8-bf80fa49ef7d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.354694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072098-c13d-49db-b6a8-bf80fa49ef7d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.354981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c072098-c13d-49db-b6a8-bf80fa49ef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.375785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9c072098-c13d-49db-b6a8-bf80fa49ef7d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:26.377032 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9c072098-c13d-49db-b6a8-bf80fa49ef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:26.385971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 975/1970] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:26.390648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daea140-23c3-4acb-ad6c-07beec4d08cf None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:26.400495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daea140-23c3-4acb-ad6c-07beec4d08cf None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:26.405275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:26.405876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.406159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.406434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.407165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:26.407473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:26.409221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:26.421126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 996/1971] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:26.426154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c072098-c13d-49db-b6a8-bf80fa49ef7d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:26.435648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c072098-c13d-49db-b6a8-bf80fa49ef7d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:26.440547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507d9f7-ddc3-4928-9e79-3589f347a943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:26.441661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507d9f7-ddc3-4928-9e79-3589f347a943 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.441943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507d9f7-ddc3-4928-9e79-3589f347a943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.442214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507d9f7-ddc3-4928-9e79-3589f347a943 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.442891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507d9f7-ddc3-4928-9e79-3589f347a943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:26.445934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507d9f7-ddc3-4928-9e79-3589f347a943 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:26.574499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 976/1972] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:26 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:26.578614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:26.589139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397db6e9-10d3-4492-92c5-2c720febfa64 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:26.651698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd641f-2bb8-4e58-b1e2-ed462fad0e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:26.652334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd641f-2bb8-4e58-b1e2-ed462fad0e2c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.652623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd641f-2bb8-4e58-b1e2-ed462fad0e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.652902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd641f-2bb8-4e58-b1e2-ed462fad0e2c admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.653567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd641f-2bb8-4e58-b1e2-ed462fad0e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:26.655509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd641f-2bb8-4e58-b1e2-ed462fad0e2c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:26.728112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 997/1973] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:26 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:26.732456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507d9f7-ddc3-4928-9e79-3589f347a943 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:26.744102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507d9f7-ddc3-4928-9e79-3589f347a943 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:26.749395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69d000-232b-4021-abba-6b77861f64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:26.750114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69d000-232b-4021-abba-6b77861f64cc admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.750392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69d000-232b-4021-abba-6b77861f64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.750662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69d000-232b-4021-abba-6b77861f64cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.753643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69d000-232b-4021-abba-6b77861f64cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:26.754507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69d000-232b-4021-abba-6b77861f64cc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:26.769949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 977/1974] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:26.771771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd641f-2bb8-4e58-b1e2-ed462fad0e2c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:26.781790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd641f-2bb8-4e58-b1e2-ed462fad0e2c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:26.787396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b736f5e-cf10-4c2a-9769-f58f4bf0b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:26.788084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b736f5e-cf10-4c2a-9769-f58f4bf0b6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.788417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b736f5e-cf10-4c2a-9769-f58f4bf0b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.788698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b736f5e-cf10-4c2a-9769-f58f4bf0b6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.789366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b736f5e-cf10-4c2a-9769-f58f4bf0b6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:26.791002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b736f5e-cf10-4c2a-9769-f58f4bf0b6f3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:26.802308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 998/1975] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:26.806530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69d000-232b-4021-abba-6b77861f64cc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:26.816619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69d000-232b-4021-abba-6b77861f64cc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:26.821297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666544-7f64-4a59-80ab-67d62ebf5688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:26.822013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666544-7f64-4a59-80ab-67d62ebf5688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.822298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666544-7f64-4a59-80ab-67d62ebf5688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.822575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666544-7f64-4a59-80ab-67d62ebf5688 admin admin] PATH_INFO: `/v3/projects/08117cdeb7334dfc92d52b0d8bab44fd/users/5bb8e65057064250be3fa52c8a730892/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.851426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c666544-7f64-4a59-80ab-67d62ebf5688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08117cdeb7334dfc92d52b0d8bab44fd, user_id=5bb8e65057064250be3fa52c8a730892, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:26.856770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c666544-7f64-4a59-80ab-67d62ebf5688 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:26.864714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:26.932796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 978/1976] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:26 2022] PUT /identity/v3/projects/08117cdeb7334dfc92d52b0d8bab44fd/users/5bb8e65057064250be3fa52c8a730892/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:26.943995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed01441-5c75-42e5-abaf-5f4929f8499f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:26.944277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed01441-5c75-42e5-abaf-5f4929f8499f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:26.944583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed01441-5c75-42e5-abaf-5f4929f8499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:26.976916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-eed01441-5c75-42e5-abaf-5f4929f8499f None None] MFA Rules not processed for user `5bb8e65057064250be3fa52c8a730892`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:26.978151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eed01441-5c75-42e5-abaf-5f4929f8499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:27.049657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 999/1977] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:27.054258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666544-7f64-4a59-80ab-67d62ebf5688 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:27.131240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666544-7f64-4a59-80ab-67d62ebf5688 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:27.136221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ee36-0564-4894-8aa5-a85dbe78783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:27.137123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ee36-0564-4894-8aa5-a85dbe78783f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:27.138107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ee36-0564-4894-8aa5-a85dbe78783f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:27.138479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ee36-0564-4894-8aa5-a85dbe78783f admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:27.139273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83ee36-0564-4894-8aa5-a85dbe78783f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:27.147262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83ee36-0564-4894-8aa5-a85dbe78783f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:27.262964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 979/1978] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:27 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:27.267371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed01441-5c75-42e5-abaf-5f4929f8499f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:27.279203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed01441-5c75-42e5-abaf-5f4929f8499f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:27.328262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:27.337075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38539-97ce-4f2c-93f3-5e866013fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:27.337685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38539-97ce-4f2c-93f3-5e866013fa48 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:27.337965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38539-97ce-4f2c-93f3-5e866013fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:27.338267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f38539-97ce-4f2c-93f3-5e866013fa48 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:27.338896 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38539-97ce-4f2c-93f3-5e866013fa48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:27.340909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f38539-97ce-4f2c-93f3-5e866013fa48 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:27.450181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1000/1979] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:27 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:27.451865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ee36-0564-4894-8aa5-a85dbe78783f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:27.462809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ee36-0564-4894-8aa5-a85dbe78783f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:27.468773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447909d-a8cf-4180-9f91-e9a0478adee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:27.469388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447909d-a8cf-4180-9f91-e9a0478adee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:27.469672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447909d-a8cf-4180-9f91-e9a0478adee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:27.469949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447909d-a8cf-4180-9f91-e9a0478adee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:27.470606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447909d-a8cf-4180-9f91-e9a0478adee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:27.473008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447909d-a8cf-4180-9f91-e9a0478adee8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:27.484351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 980/1980] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:27.489189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38539-97ce-4f2c-93f3-5e866013fa48 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:27.500229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f38539-97ce-4f2c-93f3-5e866013fa48 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:27.505570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac77b95-0273-4637-b4d5-1949b42e9dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:27.506034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77b95-0273-4637-b4d5-1949b42e9dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:27.506318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77b95-0273-4637-b4d5-1949b42e9dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:27.508461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac77b95-0273-4637-b4d5-1949b42e9dd6 admin admin] PATH_INFO: `/v3/projects/fc131aaca8fa4016825a5f574908b16b/users/8772c9a00be541098ac1991234440da6/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:27.548117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac77b95-0273-4637-b4d5-1949b42e9dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc131aaca8fa4016825a5f574908b16b, user_id=8772c9a00be541098ac1991234440da6, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:27.551723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac77b95-0273-4637-b4d5-1949b42e9dd6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:27.645943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1001/1981] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:27 2022] PUT /identity/v3/projects/fc131aaca8fa4016825a5f574908b16b/users/8772c9a00be541098ac1991234440da6/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:27.649864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447909d-a8cf-4180-9f91-e9a0478adee8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:27.661109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447909d-a8cf-4180-9f91-e9a0478adee8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:27.728067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94220015-05c3-4380-9a1c-08b26ae6d21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:27.728707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94220015-05c3-4380-9a1c-08b26ae6d21a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:27.728993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94220015-05c3-4380-9a1c-08b26ae6d21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:27.729261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94220015-05c3-4380-9a1c-08b26ae6d21a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:27.729906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94220015-05c3-4380-9a1c-08b26ae6d21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:27.731548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94220015-05c3-4380-9a1c-08b26ae6d21a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:27.745512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 981/1982] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:27.746804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac77b95-0273-4637-b4d5-1949b42e9dd6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:27.757343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac77b95-0273-4637-b4d5-1949b42e9dd6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:27.762199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:27.762850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:27.763378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:27.763659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] PATH_INFO: `/v3/projects/fc131aaca8fa4016825a5f574908b16b/users/8772c9a00be541098ac1991234440da6/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:27.765701 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc131aaca8fa4016825a5f574908b16b, user_id=8772c9a00be541098ac1991234440da6, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:27.768380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:27.779612 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1002/1983] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:27 2022] PUT /identity/v3/projects/fc131aaca8fa4016825a5f574908b16b/users/8772c9a00be541098ac1991234440da6/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:27.791583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10712f91-37a7-4116-b581-afdd1bf908cd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:27.791870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10712f91-37a7-4116-b581-afdd1bf908cd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:27.792169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10712f91-37a7-4116-b581-afdd1bf908cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:27.821787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-10712f91-37a7-4116-b581-afdd1bf908cd None None] MFA Rules not processed for user `8772c9a00be541098ac1991234440da6`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:27.823028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-10712f91-37a7-4116-b581-afdd1bf908cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:27.883845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:27.906134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 982/1984] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:27.922591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:27.924351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:27.986201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b166c9-ef38-4770-bee7-03a37594caa2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:27.990469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c7152-f473-4694-b63b-ec4653d0ff38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:27.991092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c7152-f473-4694-b63b-ec4653d0ff38 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:27.991374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c7152-f473-4694-b63b-ec4653d0ff38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:27.991649 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c7152-f473-4694-b63b-ec4653d0ff38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:28.002267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c7152-f473-4694-b63b-ec4653d0ff38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:28.010408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c7152-f473-4694-b63b-ec4653d0ff38 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:28.015500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1003/1985] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:28.505034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10712f91-37a7-4116-b581-afdd1bf908cd None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:28.515611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10712f91-37a7-4116-b581-afdd1bf908cd None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:28.519864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9511-7e32-4b93-9659-d0c21a0e3dde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:28.520521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9511-7e32-4b93-9659-d0c21a0e3dde service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:28.520801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9511-7e32-4b93-9659-d0c21a0e3dde service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:28.521070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9511-7e32-4b93-9659-d0c21a0e3dde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:28.578751 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9511-7e32-4b93-9659-d0c21a0e3dde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:28.580211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9511-7e32-4b93-9659-d0c21a0e3dde service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:28.590852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 983/1986] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:29.491229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c7152-f473-4694-b63b-ec4653d0ff38 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:29.504808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c7152-f473-4694-b63b-ec4653d0ff38 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:29.512736 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73e86f-2a21-437a-8995-228b3d631083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:29.516257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e86f-2a21-437a-8995-228b3d631083 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:29.516915 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e86f-2a21-437a-8995-228b3d631083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:29.517536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73e86f-2a21-437a-8995-228b3d631083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:29.521996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d73e86f-2a21-437a-8995-228b3d631083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:29.602997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73e86f-2a21-437a-8995-228b3d631083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:29.604467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73e86f-2a21-437a-8995-228b3d631083 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:29.614117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1004/1987] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:29.824285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9511-7e32-4b93-9659-d0c21a0e3dde service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:29.848831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:29.951639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9511-7e32-4b93-9659-d0c21a0e3dde service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:29.957863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:29.959202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:29.959737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:29.960016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] PATH_INFO: `/v3/users/5bb8e65057064250be3fa52c8a730892` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:29.961246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb8e65057064250be3fa52c8a730892)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:29.963912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:30.129567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb8e65057064250be3fa52c8a730892'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:30.136627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb8e65057064250be3fa52c8a730892'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:30.183235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb8e65057064250be3fa52c8a730892'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:30.196018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb8e65057064250be3fa52c8a730892'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:30.196774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb8e65057064250be3fa52c8a730892'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:30.202736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 984/1988] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:29 2022] DELETE /identity/v3/users/5bb8e65057064250be3fa52c8a730892 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:30.208391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a73f43-557e-4a0e-a1c7-a7ecfda3486a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:30.212682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a73f43-557e-4a0e-a1c7-a7ecfda3486a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:30.212682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a73f43-557e-4a0e-a1c7-a7ecfda3486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:30.231343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-90a73f43-557e-4a0e-a1c7-a7ecfda3486a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:30.233670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-90a73f43-557e-4a0e-a1c7-a7ecfda3486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:30.293094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:30.329334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1005/1989] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:30.339672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:30.341039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:30.408051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788e2c1-1009-4f9e-b741-444a02865da1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:30.419933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:30.419933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:30.419933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:30.419933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:30.426890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:30.428501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:30.439738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 985/1990] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:30.820411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a73f43-557e-4a0e-a1c7-a7ecfda3486a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:30.821948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-90a73f43-557e-4a0e-a1c7-a7ecfda3486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:30.837384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a73f43-557e-4a0e-a1c7-a7ecfda3486a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:30.851806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:30.852584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:30.853252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:30.853509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] PATH_INFO: `/v3/users/897871ccdaf7415292a859b2c460fe54` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:30.858955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897871ccdaf7415292a859b2c460fe54)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:30.861187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:31.058414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:31.059910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:31.088732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1bc05-84fa-4d0f-8ac2-4e5aa1db0569 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:31.095835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:31.097772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:31.098262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:31.098761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] PATH_INFO: `/v3/projects/08117cdeb7334dfc92d52b0d8bab44fd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:31.100253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08117cdeb7334dfc92d52b0d8bab44fd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:31.103013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:31.144666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897871ccdaf7415292a859b2c460fe54'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.157552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897871ccdaf7415292a859b2c460fe54'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.178140 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897871ccdaf7415292a859b2c460fe54'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.203402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:31.223690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08117cdeb7334dfc92d52b0d8bab44fd', 'request_id': 'req-55744a00-ecb9-4537-82bc-7bd27a1adf93'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.280043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897871ccdaf7415292a859b2c460fe54'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.280724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-dda0fdf7-b464-4c2f-a750-77c0692000c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897871ccdaf7415292a859b2c460fe54'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.288152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1006/1991] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:30 2022] DELETE /identity/v3/users/897871ccdaf7415292a859b2c460fe54 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:31.292760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60ab5-4966-4f4b-a194-51280b648ae5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:31.293048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60ab5-4966-4f4b-a194-51280b648ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:31.293325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60ab5-4966-4f4b-a194-51280b648ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:31.318435 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4ff60ab5-4966-4f4b-a194-51280b648ae5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:31.319654 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ff60ab5-4966-4f4b-a194-51280b648ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:31.366460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08117cdeb7334dfc92d52b0d8bab44fd', 'request_id': 'req-55744a00-ecb9-4537-82bc-7bd27a1adf93'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.374191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08117cdeb7334dfc92d52b0d8bab44fd', 'request_id': 'req-55744a00-ecb9-4537-82bc-7bd27a1adf93'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.385800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] The token cache is being invalidate because project 08117cdeb7334dfc92d52b0d8bab44fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:31.386092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.386862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.388623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 986/1992] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:31 2022] DELETE /identity/v3/projects/08117cdeb7334dfc92d52b0d8bab44fd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:31.393238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:31.395385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:31.396172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1007/1993] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:31.406496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff60ab5-4966-4f4b-a194-51280b648ae5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:31.408013 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ff60ab5-4966-4f4b-a194-51280b648ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:31.483089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff60ab5-4966-4f4b-a194-51280b648ae5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:31.488503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d56fd0-1eff-41b4-9fe2-013ada3ceefb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:31.489362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56fd0-1eff-41b4-9fe2-013ada3ceefb service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:31.489699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56fd0-1eff-41b4-9fe2-013ada3ceefb service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:31.490024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56fd0-1eff-41b4-9fe2-013ada3ceefb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:31.492060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e9d56fd0-1eff-41b4-9fe2-013ada3ceefb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:31.505670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55744a00-ecb9-4537-82bc-7bd27a1adf93 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:31.507216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d56fd0-1eff-41b4-9fe2-013ada3ceefb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:31.508988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d56fd0-1eff-41b4-9fe2-013ada3ceefb service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:31.512344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:31.513480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:31.514380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:31.515379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:31.515664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] PATH_INFO: `/v3/users/8772c9a00be541098ac1991234440da6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:31.517936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8772c9a00be541098ac1991234440da6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:31.522057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:31.523886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1008/1994] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:31.544796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58111b6c-dee4-433a-a99f-64a67346080d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:31.549131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58111b6c-dee4-433a-a99f-64a67346080d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:31.549131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58111b6c-dee4-433a-a99f-64a67346080d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:31.549131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1009/1995] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:26:31.569714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6815a-e177-4726-95d3-d000b72897f1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:31.577795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6815a-e177-4726-95d3-d000b72897f1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:31.577795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6815a-e177-4726-95d3-d000b72897f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:31.591925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0bc6815a-e177-4726-95d3-d000b72897f1 None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:31.593817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0bc6815a-e177-4726-95d3-d000b72897f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:31.682961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1010/1996] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:26:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:31.694500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6815a-e177-4726-95d3-d000b72897f1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:31.695880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0bc6815a-e177-4726-95d3-d000b72897f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:31.709172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6815a-e177-4726-95d3-d000b72897f1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:31.714326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:31.714963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:31.715266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:31.715796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:31.724972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:31.726070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:31.736471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1011/1997] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:31.736915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8772c9a00be541098ac1991234440da6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.744482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8772c9a00be541098ac1991234440da6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.783375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:31.785506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:31.807776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15560b-dab4-445c-980c-5f7d01986a9a service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:31.813613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:31.814396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:31.814650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:31.814924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] PATH_INFO: `/v3/users/ba828c11574b4a7cbea949fc21a1b8d7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:31.816539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba828c11574b4a7cbea949fc21a1b8d7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:31.818860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:31.822849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8772c9a00be541098ac1991234440da6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.855026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8772c9a00be541098ac1991234440da6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.855026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8772c9a00be541098ac1991234440da6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:31.867001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 987/1998] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:31 2022] DELETE /identity/v3/users/8772c9a00be541098ac1991234440da6 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:32.019868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba828c11574b4a7cbea949fc21a1b8d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.027925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba828c11574b4a7cbea949fc21a1b8d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.048066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba828c11574b4a7cbea949fc21a1b8d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.148862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba828c11574b4a7cbea949fc21a1b8d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.149317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba828c11574b4a7cbea949fc21a1b8d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.163697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:32.164947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:32.172806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1012/1999] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:31 2022] DELETE /identity/v3/users/ba828c11574b4a7cbea949fc21a1b8d7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:32.238716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:32.276756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab1fb6-6741-49af-8f5f-c0ebc3e9f6c1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:32.348262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:32.348262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:32.348262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:32.348602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] PATH_INFO: `/v3/projects/3298a99fc38742d9bd07b5ef2e6312ad` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:32.349672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=3298a99fc38742d9bd07b5ef2e6312ad)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:32.351622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:32.456409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3298a99fc38742d9bd07b5ef2e6312ad', 'request_id': 'req-1fcb7fa4-036a-4a54-946a-156445edd8af'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.516209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:32.522515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:32.532165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848da6eb-1232-4a6b-aa83-4fc172c0633c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:32.538514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3298a99fc38742d9bd07b5ef2e6312ad', 'request_id': 'req-1fcb7fa4-036a-4a54-946a-156445edd8af'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.548655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3298a99fc38742d9bd07b5ef2e6312ad', 'request_id': 'req-1fcb7fa4-036a-4a54-946a-156445edd8af'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.569210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] The token cache is being invalidate because project 3298a99fc38742d9bd07b5ef2e6312ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:32.576462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.576462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.576462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 988/2000] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:32 2022] DELETE /identity/v3/projects/3298a99fc38742d9bd07b5ef2e6312ad => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:32.576462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:32.576462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:32.609885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:32.618508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:32.619377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:32.619667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:32.619945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] PATH_INFO: `/v3/projects/fc131aaca8fa4016825a5f574908b16b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:32.621203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc131aaca8fa4016825a5f574908b16b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:32.623634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:32.649020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb7fa4-036a-4a54-946a-156445edd8af admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:32.653713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:32.654303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:32.654580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:32.654849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] PATH_INFO: `/v3/projects/5944bc980b374729bb36a1becfe2554d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:32.655964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5944bc980b374729bb36a1becfe2554d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:32.657908 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:32.739646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc131aaca8fa4016825a5f574908b16b', 'request_id': 'req-f6cf8f04-5069-498e-a83e-be2eb22e75b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.746102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc131aaca8fa4016825a5f574908b16b', 'request_id': 'req-f6cf8f04-5069-498e-a83e-be2eb22e75b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.751742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc131aaca8fa4016825a5f574908b16b', 'request_id': 'req-f6cf8f04-5069-498e-a83e-be2eb22e75b5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.786275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5944bc980b374729bb36a1becfe2554d', 'request_id': 'req-27121074-fcee-490a-9618-e0d8fe0fd4f4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.818107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] The token cache is being invalidate because project fc131aaca8fa4016825a5f574908b16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:32.818489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.819576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.821183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1013/2001] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:32 2022] DELETE /identity/v3/projects/fc131aaca8fa4016825a5f574908b16b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:32.828930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:32.828930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:32.852087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5944bc980b374729bb36a1becfe2554d', 'request_id': 'req-27121074-fcee-490a-9618-e0d8fe0fd4f4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.858856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5944bc980b374729bb36a1becfe2554d', 'request_id': 'req-27121074-fcee-490a-9618-e0d8fe0fd4f4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.869836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] The token cache is being invalidate because project 5944bc980b374729bb36a1becfe2554d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:32.870239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.870911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-27121074-fcee-490a-9618-e0d8fe0fd4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:32.872502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 989/2002] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:32 2022] DELETE /identity/v3/projects/5944bc980b374729bb36a1becfe2554d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:32.876947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae583bb8-710c-4325-b53a-53c6207a1a80 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:32.877239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae583bb8-710c-4325-b53a-53c6207a1a80 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:32.877516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae583bb8-710c-4325-b53a-53c6207a1a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:32.898336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ae583bb8-710c-4325-b53a-53c6207a1a80 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:32.898712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8f04-5069-498e-a83e-be2eb22e75b5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:32.899608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ae583bb8-710c-4325-b53a-53c6207a1a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:32.954947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:32.955530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:32.956209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:32.956518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:32.956799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] PATH_INFO: `/v3/users/d25f5a6017bd41e8b79ccf2be38491c3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:32.957954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25f5a6017bd41e8b79ccf2be38491c3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:32.959909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:32.961681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 990/2003] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:32.962903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796163f-295b-4033-b0ee-f996af1f10fd None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:32.963188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796163f-295b-4033-b0ee-f996af1f10fd None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:32.963462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796163f-295b-4033-b0ee-f996af1f10fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:32.984571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9796163f-295b-4033-b0ee-f996af1f10fd None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:32.986027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9796163f-295b-4033-b0ee-f996af1f10fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:32.995279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 991/2004] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:32.996560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c901f-0480-48cf-ba4f-69837b2503b5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:32.996902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c901f-0480-48cf-ba4f-69837b2503b5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:32.997186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c901f-0480-48cf-ba4f-69837b2503b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.018099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fd9c901f-0480-48cf-ba4f-69837b2503b5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:33.019353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fd9c901f-0480-48cf-ba4f-69837b2503b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:33.027468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 992/2005] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:33.028656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082b23-8fa8-44ca-9e43-f80f46550ac5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.028934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082b23-8fa8-44ca-9e43-f80f46550ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.032248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df082b23-8fa8-44ca-9e43-f80f46550ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.048151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-df082b23-8fa8-44ca-9e43-f80f46550ac5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:33.049372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-df082b23-8fa8-44ca-9e43-f80f46550ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:33.058834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 993/2006] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:33.059643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df082b23-8fa8-44ca-9e43-f80f46550ac5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.071733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df082b23-8fa8-44ca-9e43-f80f46550ac5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.076318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.076905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.077184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.077458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.078108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:33.078471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.080014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.092039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 994/2007] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:33.092966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.102498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8fa05-03fe-4cbd-8cea-cc24b34dbb66 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.107005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.107594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.107871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.108142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.108830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:33.109132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.110718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.123262 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 995/2008] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:33.123902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.133890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7e174-d491-452b-8cf7-362a8f286664 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.138963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455058fd-b2d2-4d39-a082-fde251851762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.139695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455058fd-b2d2-4d39-a082-fde251851762 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.140037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455058fd-b2d2-4d39-a082-fde251851762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.140346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455058fd-b2d2-4d39-a082-fde251851762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.140990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455058fd-b2d2-4d39-a082-fde251851762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.142897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455058fd-b2d2-4d39-a082-fde251851762 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.174228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25f5a6017bd41e8b79ccf2be38491c3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:33.181959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25f5a6017bd41e8b79ccf2be38491c3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:33.194676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25f5a6017bd41e8b79ccf2be38491c3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:33.254613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 996/2009] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:33 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:33.258733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455058fd-b2d2-4d39-a082-fde251851762 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.276434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25f5a6017bd41e8b79ccf2be38491c3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:33.277740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:33.278848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25f5a6017bd41e8b79ccf2be38491c3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:33.286194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1014/2010] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:32 2022] DELETE /identity/v3/users/d25f5a6017bd41e8b79ccf2be38491c3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:33.287253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.288938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:33.335121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455058fd-b2d2-4d39-a082-fde251851762 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.379644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d34fc-4f7b-45bd-909c-994ee651219a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.385102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82ab3c-a210-4ce6-8832-174d088d14b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.385912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ab3c-a210-4ce6-8832-174d088d14b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.386275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ab3c-a210-4ce6-8832-174d088d14b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.386636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82ab3c-a210-4ce6-8832-174d088d14b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.387339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82ab3c-a210-4ce6-8832-174d088d14b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.389565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82ab3c-a210-4ce6-8832-174d088d14b7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.396285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.396920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.397199 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.397466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.398140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.400124 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.501419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 997/2011] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:33 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:33.507778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1015/2012] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:33 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:33.507913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.507913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:33.509355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82ab3c-a210-4ce6-8832-174d088d14b7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.525232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82ab3c-a210-4ce6-8832-174d088d14b7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.580450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:33.609576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2de49-4208-47bd-b6d1-fbafebca6d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.610705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2de49-4208-47bd-b6d1-fbafebca6d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.613584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2de49-4208-47bd-b6d1-fbafebca6d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.613584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2de49-4208-47bd-b6d1-fbafebca6d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.614503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2de49-4208-47bd-b6d1-fbafebca6d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.616843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2de49-4208-47bd-b6d1-fbafebca6d04 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.646638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1016/2013] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:33.649257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2de49-4208-47bd-b6d1-fbafebca6d04 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.653396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff877b-1618-4f77-b22f-386d6ff2321e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.661665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7968-5bbb-4824-8014-8ea8d4cc4331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.662393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7968-5bbb-4824-8014-8ea8d4cc4331 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.662826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7968-5bbb-4824-8014-8ea8d4cc4331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.663148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7968-5bbb-4824-8014-8ea8d4cc4331 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.663918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7968-5bbb-4824-8014-8ea8d4cc4331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.666578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7968-5bbb-4824-8014-8ea8d4cc4331 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.672479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2de49-4208-47bd-b6d1-fbafebca6d04 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.680284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9b58-559f-4589-a999-1d6cac41a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.685104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9b58-559f-4589-a999-1d6cac41a580 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.685104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9b58-559f-4589-a999-1d6cac41a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.685104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9b58-559f-4589-a999-1d6cac41a580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.685104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b9b58-559f-4589-a999-1d6cac41a580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.686085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b9b58-559f-4589-a999-1d6cac41a580 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.708528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1017/2014] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:33.711837 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9b58-559f-4589-a999-1d6cac41a580 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.725076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9b58-559f-4589-a999-1d6cac41a580 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.732580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de01c1-c026-400f-b5a3-f7fd52c2930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.733262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de01c1-c026-400f-b5a3-f7fd52c2930b admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.733544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de01c1-c026-400f-b5a3-f7fd52c2930b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.733817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de01c1-c026-400f-b5a3-f7fd52c2930b admin admin] PATH_INFO: `/v3/projects/ad10898e79564ef39b1c3cbd363432c8/users/2c7afedf3b754d68b5ed7db1c903ed19/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.752658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de01c1-c026-400f-b5a3-f7fd52c2930b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad10898e79564ef39b1c3cbd363432c8, user_id=2c7afedf3b754d68b5ed7db1c903ed19, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.756378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de01c1-c026-400f-b5a3-f7fd52c2930b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.812373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 998/2015] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:33 2022] POST /identity/v3/users => generated 283 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:33.816629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7968-5bbb-4824-8014-8ea8d4cc4331 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.826504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7968-5bbb-4824-8014-8ea8d4cc4331 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.832194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbccdab-9ca0-41b3-a411-4060857453b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.832946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbccdab-9ca0-41b3-a411-4060857453b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.833236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbccdab-9ca0-41b3-a411-4060857453b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.833562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbccdab-9ca0-41b3-a411-4060857453b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.834244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbccdab-9ca0-41b3-a411-4060857453b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.835926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbccdab-9ca0-41b3-a411-4060857453b3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.843356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:33.849135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 999/2016] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:33.852702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1018/2017] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:33 2022] PUT /identity/v3/projects/ad10898e79564ef39b1c3cbd363432c8/users/2c7afedf3b754d68b5ed7db1c903ed19/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:33.853954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbccdab-9ca0-41b3-a411-4060857453b3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.861448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890658-4052-4a31-84ed-55cb21859c9f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.861735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890658-4052-4a31-84ed-55cb21859c9f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.862042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890658-4052-4a31-84ed-55cb21859c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.872132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbccdab-9ca0-41b3-a411-4060857453b3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:33.898712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-26890658-4052-4a31-84ed-55cb21859c9f None None] MFA Rules not processed for user `2c7afedf3b754d68b5ed7db1c903ed19`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:33.899941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-26890658-4052-4a31-84ed-55cb21859c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:33.967977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeeb37-1dae-4b68-b55a-ce0711507e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:33.968682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeb37-1dae-4b68-b55a-ce0711507e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:33.968967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeb37-1dae-4b68-b55a-ce0711507e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:33.969240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeeb37-1dae-4b68-b55a-ce0711507e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:33.969897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeeb37-1dae-4b68-b55a-ce0711507e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:33.972504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdeeb37-1dae-4b68-b55a-ce0711507e41 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:33.988022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1000/2018] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:33.989034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeeb37-1dae-4b68-b55a-ce0711507e41 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:33.999347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeeb37-1dae-4b68-b55a-ce0711507e41 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.004984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.005656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.006103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.006415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] PATH_INFO: `/v3/projects/3e65ed0fe2f24f428f97c9002eb9c5c3/users/94720c86020f4a1e9c9c660c9fd55663/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.027050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e65ed0fe2f24f428f97c9002eb9c5c3, user_id=94720c86020f4a1e9c9c660c9fd55663, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.030867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.041677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:34.042044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1019/2019] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:34.054415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890658-4052-4a31-84ed-55cb21859c9f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.055785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-26890658-4052-4a31-84ed-55cb21859c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:34.119002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1001/2020] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:33 2022] PUT /identity/v3/projects/3e65ed0fe2f24f428f97c9002eb9c5c3/users/94720c86020f4a1e9c9c660c9fd55663/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:34.120727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.122622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:34.125881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890658-4052-4a31-84ed-55cb21859c9f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.192223 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78239047-63df-4fbb-8029-36067ad56cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.192960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239047-63df-4fbb-8029-36067ad56cbb service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.193246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239047-63df-4fbb-8029-36067ad56cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.193615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78239047-63df-4fbb-8029-36067ad56cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.222541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf0123-7d29-4c1c-b1a0-c30c180161db admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.228886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.229520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.229862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.230059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] PATH_INFO: `/v3/projects/8c845921592442728037ec0d55e758d8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.231458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c845921592442728037ec0d55e758d8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.233533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.257869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78239047-63df-4fbb-8029-36067ad56cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.259627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78239047-63df-4fbb-8029-36067ad56cbb service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.269741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1020/2021] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:34.271146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f64a-fed4-4cb8-8e53-bf292633e5c6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.271397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f64a-fed4-4cb8-8e53-bf292633e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.271685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f64a-fed4-4cb8-8e53-bf292633e5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.302895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8ac2f64a-fed4-4cb8-8e53-bf292633e5c6 None None] MFA Rules not processed for user `94720c86020f4a1e9c9c660c9fd55663`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:34.304136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8ac2f64a-fed4-4cb8-8e53-bf292633e5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:34.334412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c845921592442728037ec0d55e758d8', 'request_id': 'req-efad1ea3-9199-4aab-84e3-224ccc90fc30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.371818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1021/2022] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:34.372690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2f64a-fed4-4cb8-8e53-bf292633e5c6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.380804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:34.384757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2f64a-fed4-4cb8-8e53-bf292633e5c6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.400697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c845921592442728037ec0d55e758d8', 'request_id': 'req-efad1ea3-9199-4aab-84e3-224ccc90fc30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.407711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c845921592442728037ec0d55e758d8', 'request_id': 'req-efad1ea3-9199-4aab-84e3-224ccc90fc30'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.418652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] The token cache is being invalidate because project 8c845921592442728037ec0d55e758d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:34.418939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.419599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.421142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1002/2023] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:34 2022] DELETE /identity/v3/projects/8c845921592442728037ec0d55e758d8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:34.422027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.423289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:34.443954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.444622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.444935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.445204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] PATH_INFO: `/v3/users/2c7afedf3b754d68b5ed7db1c903ed19` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.446338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7afedf3b754d68b5ed7db1c903ed19)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.448368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.488969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad1ea3-9199-4aab-84e3-224ccc90fc30 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.493817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e974349-6539-4b8e-8e14-91ceb3170a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.494418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974349-6539-4b8e-8e14-91ceb3170a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.494697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974349-6539-4b8e-8e14-91ceb3170a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.494965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974349-6539-4b8e-8e14-91ceb3170a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.495649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e974349-6539-4b8e-8e14-91ceb3170a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.497616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e974349-6539-4b8e-8e14-91ceb3170a6f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.515853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:34.610662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1003/2024] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:34 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:34.610662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ac703-d419-4431-920f-21374bf9b661 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.610662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ac703-d419-4431-920f-21374bf9b661 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.610662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ac703-d419-4431-920f-21374bf9b661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.615655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7afedf3b754d68b5ed7db1c903ed19'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.626310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7afedf3b754d68b5ed7db1c903ed19'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.636925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f59ac703-d419-4431-920f-21374bf9b661 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:34.638589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f59ac703-d419-4431-920f-21374bf9b661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:34.643606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7afedf3b754d68b5ed7db1c903ed19'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.699533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1004/2025] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:34.700462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ac703-d419-4431-920f-21374bf9b661 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.710401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ac703-d419-4431-920f-21374bf9b661 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.715152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e00a2-0a69-478e-93e5-0f270a68d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.715772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e00a2-0a69-478e-93e5-0f270a68d21b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.716056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e00a2-0a69-478e-93e5-0f270a68d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.716354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e00a2-0a69-478e-93e5-0f270a68d21b admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.716988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e00a2-0a69-478e-93e5-0f270a68d21b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.718968 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e00a2-0a69-478e-93e5-0f270a68d21b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.766120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7afedf3b754d68b5ed7db1c903ed19'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.766919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e576a2d0-4f89-4850-b976-e6e40edef2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7afedf3b754d68b5ed7db1c903ed19'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:34.773807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1022/2026] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:34 2022] DELETE /identity/v3/users/2c7afedf3b754d68b5ed7db1c903ed19 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:34.777269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a2e7-ce22-48ec-92c9-3941d40a2b70 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.777269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a2e7-ce22-48ec-92c9-3941d40a2b70 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.777269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a2e7-ce22-48ec-92c9-3941d40a2b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.795748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b7f0a2e7-ce22-48ec-92c9-3941d40a2b70 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:34.797003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7f0a2e7-ce22-48ec-92c9-3941d40a2b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:34.802256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1005/2027] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:34 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:34.802753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:34.803866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5dd32-8a32-4d67-9a4f-b9099d405a43 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.804375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5dd32-8a32-4d67-9a4f-b9099d405a43 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.804850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5dd32-8a32-4d67-9a4f-b9099d405a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.828567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-baf5dd32-8a32-4d67-9a4f-b9099d405a43 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:34.830075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-baf5dd32-8a32-4d67-9a4f-b9099d405a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:34.875208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1023/2028] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:34.876216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a2e7-ce22-48ec-92c9-3941d40a2b70 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.878210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7f0a2e7-ce22-48ec-92c9-3941d40a2b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:34.896800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a2e7-ce22-48ec-92c9-3941d40a2b70 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.902889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160f9e2-dab8-4024-8feb-9f9201e54d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.903515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160f9e2-dab8-4024-8feb-9f9201e54d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.903801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160f9e2-dab8-4024-8feb-9f9201e54d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.904075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160f9e2-dab8-4024-8feb-9f9201e54d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.904772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160f9e2-dab8-4024-8feb-9f9201e54d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.906498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160f9e2-dab8-4024-8feb-9f9201e54d1d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.912725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1006/2029] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:34.913933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5dd32-8a32-4d67-9a4f-b9099d405a43 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.919521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1024/2030] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:34.923468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160f9e2-dab8-4024-8feb-9f9201e54d1d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.928017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5dd32-8a32-4d67-9a4f-b9099d405a43 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.935156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160f9e2-dab8-4024-8feb-9f9201e54d1d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:34.941054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472f075-05d4-4253-99ed-3c2298d58101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.941250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472f075-05d4-4253-99ed-3c2298d58101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.941438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:34.941636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472f075-05d4-4253-99ed-3c2298d58101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.941922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2472f075-05d4-4253-99ed-3c2298d58101 admin admin] PATH_INFO: `/v3/projects/95f4ac5402bb4d4f839d3fedabc4309f/users/d0aadd30220e485f881435438a13527b/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.942030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:34.942281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:34.944440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:34.945145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:34.945458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.947169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.965976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472f075-05d4-4253-99ed-3c2298d58101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f4ac5402bb4d4f839d3fedabc4309f, user_id=d0aadd30220e485f881435438a13527b, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:34.969117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2472f075-05d4-4253-99ed-3c2298d58101 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:34.978855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1007/2031] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:34.978855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:34.980630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:35.047053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:35.058715 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c2be8-d16e-439b-92d8-86c8047b6893 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.062403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eaee6-4428-48ae-9e8b-9ca72677a180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.063014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eaee6-4428-48ae-9e8b-9ca72677a180 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.063297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eaee6-4428-48ae-9e8b-9ca72677a180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.063566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eaee6-4428-48ae-9e8b-9ca72677a180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.078806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1025/2032] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:34 2022] PUT /identity/v3/projects/95f4ac5402bb4d4f839d3fedabc4309f/users/d0aadd30220e485f881435438a13527b/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:35.079470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472f075-05d4-4253-99ed-3c2298d58101 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.084713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899eaee6-4428-48ae-9e8b-9ca72677a180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.086439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899eaee6-4428-48ae-9e8b-9ca72677a180 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.100154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1008/2033] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:35.101168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eaee6-4428-48ae-9e8b-9ca72677a180 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.112693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eaee6-4428-48ae-9e8b-9ca72677a180 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.166153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2472f075-05d4-4253-99ed-3c2298d58101 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.176617 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfe238-0200-4aeb-a2e6-7748255f2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.177375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe238-0200-4aeb-a2e6-7748255f2d34 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.177852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe238-0200-4aeb-a2e6-7748255f2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.178266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe238-0200-4aeb-a2e6-7748255f2d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.179017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfe238-0200-4aeb-a2e6-7748255f2d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.181287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfe238-0200-4aeb-a2e6-7748255f2d34 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.190762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900ffc9-b5f4-4901-a2da-445255431175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.191309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900ffc9-b5f4-4901-a2da-445255431175 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.191799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900ffc9-b5f4-4901-a2da-445255431175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.192161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900ffc9-b5f4-4901-a2da-445255431175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.192947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900ffc9-b5f4-4901-a2da-445255431175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.198979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900ffc9-b5f4-4901-a2da-445255431175 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.206259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1009/2034] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:35.210974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900ffc9-b5f4-4901-a2da-445255431175 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.227567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900ffc9-b5f4-4901-a2da-445255431175 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.228092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08dc17-97a4-4188-a12f-c9f112897c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.228795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08dc17-97a4-4188-a12f-c9f112897c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.229078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08dc17-97a4-4188-a12f-c9f112897c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.229354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08dc17-97a4-4188-a12f-c9f112897c65 admin admin] PATH_INFO: `/v3/projects/95f4ac5402bb4d4f839d3fedabc4309f/users/d0aadd30220e485f881435438a13527b/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.231288 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08dc17-97a4-4188-a12f-c9f112897c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f4ac5402bb4d4f839d3fedabc4309f, user_id=d0aadd30220e485f881435438a13527b, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.234004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08dc17-97a4-4188-a12f-c9f112897c65 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.244934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1010/2035] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:35 2022] PUT /identity/v3/projects/95f4ac5402bb4d4f839d3fedabc4309f/users/d0aadd30220e485f881435438a13527b/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:35.256913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552128-ce37-46ec-b79a-8ef0de3d1f1b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.257214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552128-ce37-46ec-b79a-8ef0de3d1f1b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.257491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8552128-ce37-46ec-b79a-8ef0de3d1f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.279808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1026/2036] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:35 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:35.282173 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfe238-0200-4aeb-a2e6-7748255f2d34 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.315699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e8552128-ce37-46ec-b79a-8ef0de3d1f1b None None] MFA Rules not processed for user `d0aadd30220e485f881435438a13527b`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:35.318447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e8552128-ce37-46ec-b79a-8ef0de3d1f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:35.369656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfe238-0200-4aeb-a2e6-7748255f2d34 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.374762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7d75a-95d3-4c61-b886-746a7879c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.375376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7d75a-95d3-4c61-b886-746a7879c30c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.375660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7d75a-95d3-4c61-b886-746a7879c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.375935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7d75a-95d3-4c61-b886-746a7879c30c admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.376633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7d75a-95d3-4c61-b886-746a7879c30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.379239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7d75a-95d3-4c61-b886-746a7879c30c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.387594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:35.426063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1011/2037] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:35.437796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552128-ce37-46ec-b79a-8ef0de3d1f1b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.439529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e8552128-ce37-46ec-b79a-8ef0de3d1f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:35.482944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1027/2038] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:35 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:35.487303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7d75a-95d3-4c61-b886-746a7879c30c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.500262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7d75a-95d3-4c61-b886-746a7879c30c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.505936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ccc9c-1e16-4000-acfd-70a4212cfeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.506631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ccc9c-1e16-4000-acfd-70a4212cfeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.507108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ccc9c-1e16-4000-acfd-70a4212cfeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.507323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ccc9c-1e16-4000-acfd-70a4212cfeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.508139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ccc9c-1e16-4000-acfd-70a4212cfeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.508688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8552128-ce37-46ec-b79a-8ef0de3d1f1b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.510468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ccc9c-1e16-4000-acfd-70a4212cfeb1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.514017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.514636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.514916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.515185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.526138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1028/2039] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:35.526681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.528203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.528515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ccc9c-1e16-4000-acfd-70a4212cfeb1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.532571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:35.538780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1012/2040] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:35.545683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ccc9c-1e16-4000-acfd-70a4212cfeb1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.556350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbcec6-c039-4e9b-b75e-5740054c3ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.556350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbcec6-c039-4e9b-b75e-5740054c3ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.556350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbcec6-c039-4e9b-b75e-5740054c3ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.556350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbcec6-c039-4e9b-b75e-5740054c3ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.556991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbcec6-c039-4e9b-b75e-5740054c3ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.556991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbcec6-c039-4e9b-b75e-5740054c3ac5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.559850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.565925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:35.570130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1029/2041] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:35.572008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbcec6-c039-4e9b-b75e-5740054c3ac5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.585388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7573-b364-4069-94b8-2026d6315058 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.586007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbcec6-c039-4e9b-b75e-5740054c3ac5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.590469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.590634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2570ef-e79c-4f91-81cb-924d1c46cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.591101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.591283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2570ef-e79c-4f91-81cb-924d1c46cd7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.591395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.591639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] PATH_INFO: `/v3/projects/ad10898e79564ef39b1c3cbd363432c8` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.591738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2570ef-e79c-4f91-81cb-924d1c46cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.592007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2570ef-e79c-4f91-81cb-924d1c46cd7a admin admin] PATH_INFO: `/v3/projects/6a2e64bcf7044578b501c776c8aa9f85/users/f6c091b6fa674590be6ddb758fd9b456/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.593065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad10898e79564ef39b1c3cbd363432c8)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.595076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.608372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2570ef-e79c-4f91-81cb-924d1c46cd7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2e64bcf7044578b501c776c8aa9f85, user_id=f6c091b6fa674590be6ddb758fd9b456, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.615029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2570ef-e79c-4f91-81cb-924d1c46cd7a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.743770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1030/2042] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:35 2022] PUT /identity/v3/projects/6a2e64bcf7044578b501c776c8aa9f85/users/f6c091b6fa674590be6ddb758fd9b456/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:35.755562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72d299-77d9-41aa-92a2-a96981fd42e5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.755879 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72d299-77d9-41aa-92a2-a96981fd42e5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.756174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72d299-77d9-41aa-92a2-a96981fd42e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.756369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad10898e79564ef39b1c3cbd363432c8', 'request_id': 'req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:35.785618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2a72d299-77d9-41aa-92a2-a96981fd42e5 None None] MFA Rules not processed for user `f6c091b6fa674590be6ddb758fd9b456`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:35.786842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2a72d299-77d9-41aa-92a2-a96981fd42e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:35.840568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad10898e79564ef39b1c3cbd363432c8', 'request_id': 'req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:35.848184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad10898e79564ef39b1c3cbd363432c8', 'request_id': 'req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:35.852975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1031/2043] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:35.856803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72d299-77d9-41aa-92a2-a96981fd42e5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.863914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] The token cache is being invalidate because project ad10898e79564ef39b1c3cbd363432c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:35.864313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:35.865371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:35.866941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1013/2044] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:35 2022] DELETE /identity/v3/projects/ad10898e79564ef39b1c3cbd363432c8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:35.867695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:35.869176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:35.911965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72d299-77d9-41aa-92a2-a96981fd42e5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.915738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d3243-4035-4bad-8c7f-6ae012004921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.916377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3243-4035-4bad-8c7f-6ae012004921 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.916661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3243-4035-4bad-8c7f-6ae012004921 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.916940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d3243-4035-4bad-8c7f-6ae012004921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.918709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-947d3243-4035-4bad-8c7f-6ae012004921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:35.936061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e393b1a-4932-4c41-b2f7-d02b9faf6e7c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:35.941595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62a5da-d03b-44c9-bec0-af8d690074cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:35.942201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a5da-d03b-44c9-bec0-af8d690074cc admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.942477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a5da-d03b-44c9-bec0-af8d690074cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.942749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a5da-d03b-44c9-bec0-af8d690074cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:35.943378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62a5da-d03b-44c9-bec0-af8d690074cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.945400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62a5da-d03b-44c9-bec0-af8d690074cc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.966856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:35.980778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d3243-4035-4bad-8c7f-6ae012004921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:35.982217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d3243-4035-4bad-8c7f-6ae012004921 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:35.991066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1032/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:35.992464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b78c4-da84-4145-99f5-cfdc9fe9941f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:35.992831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b78c4-da84-4145-99f5-cfdc9fe9941f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:35.993116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b78c4-da84-4145-99f5-cfdc9fe9941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.012706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-028b78c4-da84-4145-99f5-cfdc9fe9941f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:36.014228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-028b78c4-da84-4145-99f5-cfdc9fe9941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:36.023230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1033/2046] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:36.032506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f80e8-3b33-4a99-8796-e5a98fe8f66d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.033022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f80e8-3b33-4a99-8796-e5a98fe8f66d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.033318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f80e8-3b33-4a99-8796-e5a98fe8f66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.053453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a01f80e8-3b33-4a99-8796-e5a98fe8f66d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:36.054638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a01f80e8-3b33-4a99-8796-e5a98fe8f66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:36.068594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1034/2047] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:36.069004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1014/2048] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:35 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:36.069425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62a5da-d03b-44c9-bec0-af8d690074cc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.069540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f80e8-3b33-4a99-8796-e5a98fe8f66d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.082123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f80e8-3b33-4a99-8796-e5a98fe8f66d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.145288 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62a5da-d03b-44c9-bec0-af8d690074cc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.150258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005c69-6095-4d6d-867e-ce830f67c602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.150870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005c69-6095-4d6d-867e-ce830f67c602 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.151147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005c69-6095-4d6d-867e-ce830f67c602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.151250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.151415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9005c69-6095-4d6d-867e-ce830f67c602 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.151996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.152118 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9005c69-6095-4d6d-867e-ce830f67c602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.152454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.152785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.153578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:36.154611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.154755 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9005c69-6095-4d6d-867e-ce830f67c602 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.155707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.167961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:36.179470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1035/2049] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:36.182577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.195425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b2d5b-6679-474a-87cb-1115ef836017 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.200638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8030f-4d21-46a0-9668-dfc9b111d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.201318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8030f-4d21-46a0-9668-dfc9b111d8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.201561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8030f-4d21-46a0-9668-dfc9b111d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.201840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8030f-4d21-46a0-9668-dfc9b111d8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.202480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8030f-4d21-46a0-9668-dfc9b111d8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.204544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8030f-4d21-46a0-9668-dfc9b111d8d2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.269185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1015/2050] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:36 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:36.273056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005c69-6095-4d6d-867e-ce830f67c602 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.282564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9005c69-6095-4d6d-867e-ce830f67c602 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.287631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08787623-db77-4b6b-af49-19d9f79008f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.288177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787623-db77-4b6b-af49-19d9f79008f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.288510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787623-db77-4b6b-af49-19d9f79008f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.288784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08787623-db77-4b6b-af49-19d9f79008f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.289441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08787623-db77-4b6b-af49-19d9f79008f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.291172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08787623-db77-4b6b-af49-19d9f79008f3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.304815 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1016/2051] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:36.306110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08787623-db77-4b6b-af49-19d9f79008f3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.316058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08787623-db77-4b6b-af49-19d9f79008f3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.320899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c922e34-59cb-45f0-9fbf-5a65405a1a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.321567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922e34-59cb-45f0-9fbf-5a65405a1a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.321852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922e34-59cb-45f0-9fbf-5a65405a1a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.322151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922e34-59cb-45f0-9fbf-5a65405a1a5f admin admin] PATH_INFO: `/v3/projects/a6c2822f4df343a3a89ecfc9f4ab983b/users/f812e0beebfd46109629f53f64c1b2c2/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.337225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c922e34-59cb-45f0-9fbf-5a65405a1a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c2822f4df343a3a89ecfc9f4ab983b, user_id=f812e0beebfd46109629f53f64c1b2c2, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.339449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1036/2052] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:36 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:36.340933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c922e34-59cb-45f0-9fbf-5a65405a1a5f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.343515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8030f-4d21-46a0-9668-dfc9b111d8d2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.406402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8030f-4d21-46a0-9668-dfc9b111d8d2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.411625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e61cbc-7ba2-4163-a52f-07328f6a1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.412238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61cbc-7ba2-4163-a52f-07328f6a1a82 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.412562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61cbc-7ba2-4163-a52f-07328f6a1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.412840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61cbc-7ba2-4163-a52f-07328f6a1a82 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.413485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e61cbc-7ba2-4163-a52f-07328f6a1a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.415463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e61cbc-7ba2-4163-a52f-07328f6a1a82 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.459434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1017/2053] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:36 2022] PUT /identity/v3/projects/a6c2822f4df343a3a89ecfc9f4ab983b/users/f812e0beebfd46109629f53f64c1b2c2/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:36.463317 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c922e34-59cb-45f0-9fbf-5a65405a1a5f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.486353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1037/2054] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:36 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:36.487414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e61cbc-7ba2-4163-a52f-07328f6a1a82 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.498770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e61cbc-7ba2-4163-a52f-07328f6a1a82 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.550877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c922e34-59cb-45f0-9fbf-5a65405a1a5f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.553693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:36.557160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ec68-ee35-4a01-8f38-41468c3dede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.557774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ec68-ee35-4a01-8f38-41468c3dede6 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.558052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ec68-ee35-4a01-8f38-41468c3dede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.558327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ec68-ee35-4a01-8f38-41468c3dede6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.558985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325ec68-ee35-4a01-8f38-41468c3dede6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.561206 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325ec68-ee35-4a01-8f38-41468c3dede6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.573749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1018/2055] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:36.578149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ec68-ee35-4a01-8f38-41468c3dede6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.590848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ec68-ee35-4a01-8f38-41468c3dede6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.595934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180cb4d-74e2-44a4-8dda-e09bccdcada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.596632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180cb4d-74e2-44a4-8dda-e09bccdcada4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.597126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180cb4d-74e2-44a4-8dda-e09bccdcada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.597708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180cb4d-74e2-44a4-8dda-e09bccdcada4 admin admin] PATH_INFO: `/v3/projects/a6c2822f4df343a3a89ecfc9f4ab983b/users/f812e0beebfd46109629f53f64c1b2c2/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.598304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ce30-1704-42eb-9a8a-e4491e1f6f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.599242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce30-1704-42eb-9a8a-e4491e1f6f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.599661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce30-1704-42eb-9a8a-e4491e1f6f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.599953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180cb4d-74e2-44a4-8dda-e09bccdcada4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c2822f4df343a3a89ecfc9f4ab983b, user_id=f812e0beebfd46109629f53f64c1b2c2, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.600110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311ce30-1704-42eb-9a8a-e4491e1f6f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.600902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ce30-1704-42eb-9a8a-e4491e1f6f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.602717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180cb4d-74e2-44a4-8dda-e09bccdcada4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.603237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311ce30-1704-42eb-9a8a-e4491e1f6f69 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.616963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1019/2056] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:36 2022] PUT /identity/v3/projects/a6c2822f4df343a3a89ecfc9f4ab983b/users/f812e0beebfd46109629f53f64c1b2c2/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:36.620739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1038/2057] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:36.627149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4225f4-518c-416e-9ffe-40124581bc16 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.627521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4225f4-518c-416e-9ffe-40124581bc16 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.627827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4225f4-518c-416e-9ffe-40124581bc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.630455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ce30-1704-42eb-9a8a-e4491e1f6f69 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.654330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311ce30-1704-42eb-9a8a-e4491e1f6f69 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.686306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3f4225f4-518c-416e-9ffe-40124581bc16 None None] MFA Rules not processed for user `f812e0beebfd46109629f53f64c1b2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:36.686306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3f4225f4-518c-416e-9ffe-40124581bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:36.729529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.730147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.730428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.730703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.731356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.732978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.743943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1039/2058] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:36.745276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.747703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:36.762435 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601158e-ee5b-4999-802d-5bf7d1300b88 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.766763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1020/2059] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:36.767722 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4225f4-518c-416e-9ffe-40124581bc16 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.777611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.778717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.779652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.780007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] PATH_INFO: `/v3/users/e30d7fdb6e544767b8851e2af7ad682d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.781137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4225f4-518c-416e-9ffe-40124581bc16 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.781748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e30d7fdb6e544767b8851e2af7ad682d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.783665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.786849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.787516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.787788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.788057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] PATH_INFO: `/v3/projects/bf1439f159904209bedb1fd3daad6bd7/users/81ed9e4288a148d59632759d1c9fd706/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:36.807550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1439f159904209bedb1fd3daad6bd7, user_id=81ed9e4288a148d59632759d1c9fd706, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:36.810766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:36.891462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1021/2060] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:36 2022] PUT /identity/v3/projects/bf1439f159904209bedb1fd3daad6bd7/users/81ed9e4288a148d59632759d1c9fd706/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:36.892691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:36.900824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:36.907235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:36.945259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e30d7fdb6e544767b8851e2af7ad682d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:36.952324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e30d7fdb6e544767b8851e2af7ad682d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:36.961718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733076d0-3229-41db-895c-66b98e5ae356 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:36.965463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b400713-4d1f-43c8-ad68-84e22d4bab47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:36.967192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e30d7fdb6e544767b8851e2af7ad682d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:36.967302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400713-4d1f-43c8-ad68-84e22d4bab47 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:36.967302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400713-4d1f-43c8-ad68-84e22d4bab47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:36.967302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b400713-4d1f-43c8-ad68-84e22d4bab47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:37.006330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e30d7fdb6e544767b8851e2af7ad682d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:37.007396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-15e807e4-7a2b-419c-872a-da9f26534d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e30d7fdb6e544767b8851e2af7ad682d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:37.014118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1040/2061] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:36 2022] DELETE /identity/v3/users/e30d7fdb6e544767b8851e2af7ad682d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:37.015344 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f02ac-ce29-412c-bacd-5fd2fbc87fb3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:37.015797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f02ac-ce29-412c-bacd-5fd2fbc87fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:37.016129 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f02ac-ce29-412c-bacd-5fd2fbc87fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:37.031070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b400713-4d1f-43c8-ad68-84e22d4bab47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:37.032563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b400713-4d1f-43c8-ad68-84e22d4bab47 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:37.042060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1022/2062] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:37.043267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9b738-34f9-4cba-a153-d45393e93902 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:37.043553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9b738-34f9-4cba-a153-d45393e93902 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:37.043828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9b738-34f9-4cba-a153-d45393e93902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:37.045897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1d9f02ac-ce29-412c-bacd-5fd2fbc87fb3 None None] MFA Rules not processed for user `81ed9e4288a148d59632759d1c9fd706`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:37.047320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d9f02ac-ce29-412c-bacd-5fd2fbc87fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:37.063030 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-91a9b738-34f9-4cba-a153-d45393e93902 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:37.064274 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-91a9b738-34f9-4cba-a153-d45393e93902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:37.080010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:37.119207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1041/2063] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:37.133842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1023/2064] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:37.134115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f02ac-ce29-412c-bacd-5fd2fbc87fb3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:37.135637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d9f02ac-ce29-412c-bacd-5fd2fbc87fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:37.145853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9b738-34f9-4cba-a153-d45393e93902 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:37.147293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-91a9b738-34f9-4cba-a153-d45393e93902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:37.198871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f02ac-ce29-412c-bacd-5fd2fbc87fb3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:37.203808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00283447a1a6405b952e541a13c91110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:37.204622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:37.205126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:37.205410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:37.205589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9b738-34f9-4cba-a153-d45393e93902 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:37.210025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:37.210647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:37.210924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:37.211196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:37.216002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:37.217477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:37.220632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:37.222129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:37.226049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:37.226602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1042/2065] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:37.228042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:37.229453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:37.232666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1024/2066] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:37.298754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e2e7a-f6f1-4494-a33a-b7fb86111302 service glance] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:37.302965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:37.303673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:37.304012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:37.304433 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:37.307307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:37.386568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:37.388576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:37.399582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1043/2067] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:38.043837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:38.044971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:38.058621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4665fe-cdd0-47c9-9d6d-d7a0427d7bff service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:38.063634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:38.064406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:38.064685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:38.064957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] PATH_INFO: `/v3/projects/0af790060388467f9c75a0697e3b6b2d` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:38.066422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af790060388467f9c75a0697e3b6b2d)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:38.068536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:38.216852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af790060388467f9c75a0697e3b6b2d', 'request_id': 'req-4dd8a63b-3876-4540-88ad-8e2e78f934ea'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:38.291996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af790060388467f9c75a0697e3b6b2d', 'request_id': 'req-4dd8a63b-3876-4540-88ad-8e2e78f934ea'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:38.298851 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af790060388467f9c75a0697e3b6b2d', 'request_id': 'req-4dd8a63b-3876-4540-88ad-8e2e78f934ea'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:38.309226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] The token cache is being invalidate because project 0af790060388467f9c75a0697e3b6b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:38.309517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:38.310152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4dd8a63b-3876-4540-88ad-8e2e78f934ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:38.311642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1025/2068] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:38 2022] DELETE /identity/v3/projects/0af790060388467f9c75a0697e3b6b2d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:40.369845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:40.371355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:40.386076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fdf6b-4b98-4d7d-95bc-994f4bc6a00a service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:40.411791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:40.444910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:40.445547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:40.445832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:40.446109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] PATH_INFO: `/v3/users/94720c86020f4a1e9c9c660c9fd55663` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:40.447265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=94720c86020f4a1e9c9c660c9fd55663)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:40.449329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:40.682864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94720c86020f4a1e9c9c660c9fd55663'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:40.689736 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94720c86020f4a1e9c9c660c9fd55663'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:40.702225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94720c86020f4a1e9c9c660c9fd55663'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:40.777627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94720c86020f4a1e9c9c660c9fd55663'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:40.778298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94720c86020f4a1e9c9c660c9fd55663'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:40.785580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1044/2069] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:40 2022] DELETE /identity/v3/users/94720c86020f4a1e9c9c660c9fd55663 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:40.790079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32513090-0dd7-4602-836f-e2a08de1af99 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:40.790587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32513090-0dd7-4602-836f-e2a08de1af99 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:40.790688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32513090-0dd7-4602-836f-e2a08de1af99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:40.810085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-32513090-0dd7-4602-836f-e2a08de1af99 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:40.811330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-32513090-0dd7-4602-836f-e2a08de1af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:40.877423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1026/2070] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:40.887558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:40.889277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:40.948159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3d33b-69b5-4567-b92d-ae93eb7b1edb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:40.951737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6017c4-3953-4855-bf5c-ee1f123c0c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:40.952361 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6017c4-3953-4855-bf5c-ee1f123c0c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:40.952643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6017c4-3953-4855-bf5c-ee1f123c0c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:40.952912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6017c4-3953-4855-bf5c-ee1f123c0c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:40.961952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6017c4-3953-4855-bf5c-ee1f123c0c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:40.963371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6017c4-3953-4855-bf5c-ee1f123c0c42 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:40.973471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1045/2071] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:41.427885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32513090-0dd7-4602-836f-e2a08de1af99 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:41.429506 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-32513090-0dd7-4602-836f-e2a08de1af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:41.452222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32513090-0dd7-4602-836f-e2a08de1af99 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:41.459129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:41.459775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:41.460087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:41.460483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] PATH_INFO: `/v3/projects/3e65ed0fe2f24f428f97c9002eb9c5c3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:41.467805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e65ed0fe2f24f428f97c9002eb9c5c3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:41.474343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:41.641012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e65ed0fe2f24f428f97c9002eb9c5c3', 'request_id': 'req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:41.801085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e65ed0fe2f24f428f97c9002eb9c5c3', 'request_id': 'req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:41.808057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e65ed0fe2f24f428f97c9002eb9c5c3', 'request_id': 'req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:41.818608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] The token cache is being invalidate because project 3e65ed0fe2f24f428f97c9002eb9c5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:41.818903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:41.819541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:41.821067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1027/2072] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:41 2022] DELETE /identity/v3/projects/3e65ed0fe2f24f428f97c9002eb9c5c3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:41.825230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6017c4-3953-4855-bf5c-ee1f123c0c42 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:41.838598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6017c4-3953-4855-bf5c-ee1f123c0c42 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:41.899703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:41.905059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:41.905745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:41.906028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:41.906327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] PATH_INFO: `/v3/users/d0aadd30220e485f881435438a13527b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:41.907450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0aadd30220e485f881435438a13527b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:41.910295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:42.128035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0aadd30220e485f881435438a13527b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.136128 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0aadd30220e485f881435438a13527b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.152186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0aadd30220e485f881435438a13527b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.251665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0aadd30220e485f881435438a13527b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.252501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0aadd30220e485f881435438a13527b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.259968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1046/2073] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:41 2022] DELETE /identity/v3/users/d0aadd30220e485f881435438a13527b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:42.604742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:42.606270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:42.617052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:42.620678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f9f8a-2c4d-4caa-85c5-fbaccc155dd9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:42.678098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:42.678663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:42.680549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:42.681400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] PATH_INFO: `/v3/users/f6c091b6fa674590be6ddb758fd9b456` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:42.682727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c091b6fa674590be6ddb758fd9b456)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:42.684924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:42.723003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:42.724522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:42.739502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28871-1853-4dc0-a372-c486a241828a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:42.745043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:42.745723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:42.746005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:42.746287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] PATH_INFO: `/v3/projects/95f4ac5402bb4d4f839d3fedabc4309f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:42.747560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f4ac5402bb4d4f839d3fedabc4309f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:42.749616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:42.856839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c091b6fa674590be6ddb758fd9b456'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.858895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f4ac5402bb4d4f839d3fedabc4309f', 'request_id': 'req-1b33dd2f-a227-41a2-81ea-65452a9ee06d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.864691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c091b6fa674590be6ddb758fd9b456'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.865584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f4ac5402bb4d4f839d3fedabc4309f', 'request_id': 'req-1b33dd2f-a227-41a2-81ea-65452a9ee06d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.871307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f4ac5402bb4d4f839d3fedabc4309f', 'request_id': 'req-1b33dd2f-a227-41a2-81ea-65452a9ee06d'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.931937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c091b6fa674590be6ddb758fd9b456'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.947587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c091b6fa674590be6ddb758fd9b456'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.948436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-75d5e7ad-97ef-44eb-9e71-b7be050fc84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c091b6fa674590be6ddb758fd9b456'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.955676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1028/2074] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:42 2022] DELETE /identity/v3/users/f6c091b6fa674590be6ddb758fd9b456 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:42.961762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830a08-2782-42ef-80f1-699ba2546f55 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:42.962051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830a08-2782-42ef-80f1-699ba2546f55 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:42.962336 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830a08-2782-42ef-80f1-699ba2546f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:42.982265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0f830a08-2782-42ef-80f1-699ba2546f55 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:42.983672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0f830a08-2782-42ef-80f1-699ba2546f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:42.995359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] The token cache is being invalidate because project 95f4ac5402bb4d4f839d3fedabc4309f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:42.995783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.996671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1b33dd2f-a227-41a2-81ea-65452a9ee06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:42.998437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1047/2075] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:42 2022] DELETE /identity/v3/projects/95f4ac5402bb4d4f839d3fedabc4309f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:43.003858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d59b2-c542-4ae9-9663-ae0a5869452d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.004141 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d59b2-c542-4ae9-9663-ae0a5869452d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.004537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d59b2-c542-4ae9-9663-ae0a5869452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.026271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-616d59b2-c542-4ae9-9663-ae0a5869452d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:43.028142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-616d59b2-c542-4ae9-9663-ae0a5869452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:43.051463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1029/2076] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:43.062321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830a08-2782-42ef-80f1-699ba2546f55 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.063773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0f830a08-2782-42ef-80f1-699ba2546f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:43.079480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:43.105191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:43.106167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1048/2077] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:43.113281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97c3f-419c-40ff-a774-c8667c545b7f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.113568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97c3f-419c-40ff-a774-c8667c545b7f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.113855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97c3f-419c-40ff-a774-c8667c545b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.133912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fff97c3f-419c-40ff-a774-c8667c545b7f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:43.135119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fff97c3f-419c-40ff-a774-c8667c545b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:43.141766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830a08-2782-42ef-80f1-699ba2546f55 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.144767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1049/2078] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:43.146332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860daa94-6d87-41ec-92b3-a0cdb86d77cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.146939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860daa94-6d87-41ec-92b3-a0cdb86d77cb service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.147249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860daa94-6d87-41ec-92b3-a0cdb86d77cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.147521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860daa94-6d87-41ec-92b3-a0cdb86d77cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.149011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff97c3f-419c-40ff-a774-c8667c545b7f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.156727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860daa94-6d87-41ec-92b3-a0cdb86d77cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.158043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff97c3f-419c-40ff-a774-c8667c545b7f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.158147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860daa94-6d87-41ec-92b3-a0cdb86d77cb service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.163112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.163771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.164050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.164447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.165036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:43.165340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.166925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.167865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1030/2079] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:43.183496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1050/2080] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:43.185350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860daa94-6d87-41ec-92b3-a0cdb86d77cb service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.196565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860daa94-6d87-41ec-92b3-a0cdb86d77cb service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.201743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba195b55-57b6-45eb-9785-75b30e442dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.202524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba195b55-57b6-45eb-9785-75b30e442dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.202805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba195b55-57b6-45eb-9785-75b30e442dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.203081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba195b55-57b6-45eb-9785-75b30e442dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.203796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba195b55-57b6-45eb-9785-75b30e442dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.205813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba195b55-57b6-45eb-9785-75b30e442dd1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.297487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1031/2081] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:43 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:43.299528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.310271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c6d7-16a4-4e0c-9c03-6d41579546ca admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.368726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4deecd-4036-4e0c-90db-002cf97a1d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.369712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4deecd-4036-4e0c-90db-002cf97a1d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.369712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4deecd-4036-4e0c-90db-002cf97a1d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.369927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4deecd-4036-4e0c-90db-002cf97a1d02 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.370509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4deecd-4036-4e0c-90db-002cf97a1d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.372544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4deecd-4036-4e0c-90db-002cf97a1d02 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.465251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba195b55-57b6-45eb-9785-75b30e442dd1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.465929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1051/2082] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:43 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:43.484208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba195b55-57b6-45eb-9785-75b30e442dd1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.492283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f06e5-dc61-4ed8-b152-5afe982e25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.492283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f06e5-dc61-4ed8-b152-5afe982e25e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.492283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f06e5-dc61-4ed8-b152-5afe982e25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.493416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f06e5-dc61-4ed8-b152-5afe982e25e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.493616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f06e5-dc61-4ed8-b152-5afe982e25e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.495291 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f06e5-dc61-4ed8-b152-5afe982e25e5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.509108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1032/2083] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:43.513818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4deecd-4036-4e0c-90db-002cf97a1d02 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.525073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4deecd-4036-4e0c-90db-002cf97a1d02 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.530244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d86002-4db5-4576-8d60-584e4af1e410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.540460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d86002-4db5-4576-8d60-584e4af1e410 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.540460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d86002-4db5-4576-8d60-584e4af1e410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.540460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d86002-4db5-4576-8d60-584e4af1e410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.540460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d86002-4db5-4576-8d60-584e4af1e410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.540460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d86002-4db5-4576-8d60-584e4af1e410 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.548127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1052/2084] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:43.552658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f06e5-dc61-4ed8-b152-5afe982e25e5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.564326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f06e5-dc61-4ed8-b152-5afe982e25e5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.570484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.570676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.574074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.574074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] PATH_INFO: `/v3/projects/51627699e19d494b8ad3d0317df499cb/users/08abd391505d4aafbf0f32a286797229/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.590440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51627699e19d494b8ad3d0317df499cb, user_id=08abd391505d4aafbf0f32a286797229, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.597512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.680747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1033/2085] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:43 2022] PUT /identity/v3/projects/51627699e19d494b8ad3d0317df499cb/users/08abd391505d4aafbf0f32a286797229/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:43.692724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6bea6-68b6-4614-8db4-3baaaafd7372 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.693008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6bea6-68b6-4614-8db4-3baaaafd7372 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.693283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6bea6-68b6-4614-8db4-3baaaafd7372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.720812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a8e6bea6-68b6-4614-8db4-3baaaafd7372 None None] MFA Rules not processed for user `08abd391505d4aafbf0f32a286797229`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:43.722601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a8e6bea6-68b6-4614-8db4-3baaaafd7372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:43.773512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.775456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:43.788248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1053/2086] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:43.792421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6bea6-68b6-4614-8db4-3baaaafd7372 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:43.843303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:43.853031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614feb6a-ad11-48a1-9987-811f62c6c71c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.858011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.858670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.858910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.859182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] PATH_INFO: `/v3/projects/6a2e64bcf7044578b501c776c8aa9f85` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.860344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2e64bcf7044578b501c776c8aa9f85)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.862906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.865534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6bea6-68b6-4614-8db4-3baaaafd7372 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:43.870286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64788-c6c3-4184-9a6a-27a7c9c1ad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:43.870892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64788-c6c3-4184-9a6a-27a7c9c1ad10 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:43.871197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64788-c6c3-4184-9a6a-27a7c9c1ad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:43.871458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b64788-c6c3-4184-9a6a-27a7c9c1ad10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:43.872176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b64788-c6c3-4184-9a6a-27a7c9c1ad10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:43.875108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b64788-c6c3-4184-9a6a-27a7c9c1ad10 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:43.980486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2e64bcf7044578b501c776c8aa9f85', 'request_id': 'req-66fea502-3033-4018-9c4d-5729adabcee3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:43.981784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1054/2087] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:43 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:43.985744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64788-c6c3-4184-9a6a-27a7c9c1ad10 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:44.052557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b64788-c6c3-4184-9a6a-27a7c9c1ad10 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:44.057679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:44.058284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:44.058567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:44.058845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:44.059484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:44.061528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:44.098707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2e64bcf7044578b501c776c8aa9f85', 'request_id': 'req-66fea502-3033-4018-9c4d-5729adabcee3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.108183 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2e64bcf7044578b501c776c8aa9f85', 'request_id': 'req-66fea502-3033-4018-9c4d-5729adabcee3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.115943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:44.119770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] The token cache is being invalidate because project 6a2e64bcf7044578b501c776c8aa9f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:44.120058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.120761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.122282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1034/2088] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:43 2022] DELETE /identity/v3/projects/6a2e64bcf7044578b501c776c8aa9f85 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:44.126174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:44.127429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:44.144367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1055/2089] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:43 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:44.148777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:44.150943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:44.163483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352003a0-504b-47e3-9ae3-0cd34367f7df admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:44.168411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b910446-f692-42f1-9629-ec50c64e4cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:44.169002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b910446-f692-42f1-9629-ec50c64e4cef admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:44.169356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b910446-f692-42f1-9629-ec50c64e4cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:44.169635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b910446-f692-42f1-9629-ec50c64e4cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:44.170317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b910446-f692-42f1-9629-ec50c64e4cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:44.171921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b910446-f692-42f1-9629-ec50c64e4cef admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:44.182022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1056/2090] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:44.186046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b910446-f692-42f1-9629-ec50c64e4cef admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:44.194981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fea502-3033-4018-9c4d-5729adabcee3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:44.197041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b910446-f692-42f1-9629-ec50c64e4cef admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:44.199786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:44.200453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:44.200730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:44.201004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] PATH_INFO: `/v3/users/f812e0beebfd46109629f53f64c1b2c2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:44.201777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63771a-829b-479c-80c8-08242f1080b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:44.202135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f812e0beebfd46109629f53f64c1b2c2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:44.202447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63771a-829b-479c-80c8-08242f1080b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:44.202728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63771a-829b-479c-80c8-08242f1080b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:44.203001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63771a-829b-479c-80c8-08242f1080b1 admin admin] PATH_INFO: `/v3/projects/b5b91441de9949f48d47ec84139b59b2/users/b6f3aaee7d124d28b2549515671eecd7/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:44.204136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:44.219119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63771a-829b-479c-80c8-08242f1080b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b91441de9949f48d47ec84139b59b2, user_id=b6f3aaee7d124d28b2549515671eecd7, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:44.223081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63771a-829b-479c-80c8-08242f1080b1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:44.302985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1057/2091] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:44 2022] PUT /identity/v3/projects/b5b91441de9949f48d47ec84139b59b2/users/b6f3aaee7d124d28b2549515671eecd7/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:44.306917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63771a-829b-479c-80c8-08242f1080b1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:44.375413 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63771a-829b-479c-80c8-08242f1080b1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:44.380191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9298-d620-46af-8308-abfb8b949acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:44.380835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9298-d620-46af-8308-abfb8b949acb admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:44.381113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9298-d620-46af-8308-abfb8b949acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:44.381384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b9298-d620-46af-8308-abfb8b949acb admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:44.382028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9298-d620-46af-8308-abfb8b949acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:44.383617 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b9298-d620-46af-8308-abfb8b949acb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:44.394280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1058/2092] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:44.401155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9298-d620-46af-8308-abfb8b949acb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:44.407983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b9298-d620-46af-8308-abfb8b949acb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:44.413402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf9f3-fcdb-4aa0-aae2-769bf2fdbb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:44.414024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf9f3-fcdb-4aa0-aae2-769bf2fdbb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:44.414303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf9f3-fcdb-4aa0-aae2-769bf2fdbb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:44.414575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf9f3-fcdb-4aa0-aae2-769bf2fdbb03 admin admin] PATH_INFO: `/v3/projects/b5b91441de9949f48d47ec84139b59b2/users/b6f3aaee7d124d28b2549515671eecd7/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:44.416521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bf9f3-fcdb-4aa0-aae2-769bf2fdbb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b91441de9949f48d47ec84139b59b2, user_id=b6f3aaee7d124d28b2549515671eecd7, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:44.419166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bf9f3-fcdb-4aa0-aae2-769bf2fdbb03 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:44.429818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1059/2093] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:44 2022] PUT /identity/v3/projects/b5b91441de9949f48d47ec84139b59b2/users/b6f3aaee7d124d28b2549515671eecd7/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:44.431281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f812e0beebfd46109629f53f64c1b2c2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.438269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f812e0beebfd46109629f53f64c1b2c2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.441270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14cee1-708c-48ba-b0a5-8b0e41d09bde None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:44.441686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14cee1-708c-48ba-b0a5-8b0e41d09bde None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:44.443165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14cee1-708c-48ba-b0a5-8b0e41d09bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:44.450254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:44.472091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-eb14cee1-708c-48ba-b0a5-8b0e41d09bde None None] MFA Rules not processed for user `b6f3aaee7d124d28b2549515671eecd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:44.473423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eb14cee1-708c-48ba-b0a5-8b0e41d09bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:44.491350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f812e0beebfd46109629f53f64c1b2c2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.504472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f812e0beebfd46109629f53f64c1b2c2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.505141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f812e0beebfd46109629f53f64c1b2c2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:44.511144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1035/2094] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:44 2022] DELETE /identity/v3/users/f812e0beebfd46109629f53f64c1b2c2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:44.545906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1060/2095] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:44.558929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:44.561568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:44.631207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e942952-f81d-4389-b28a-de19a01a3ce5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:44.634883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b17ae5-fbef-46d2-b643-10bdbb2b6364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:44.635465 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17ae5-fbef-46d2-b643-10bdbb2b6364 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:44.635745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17ae5-fbef-46d2-b643-10bdbb2b6364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:44.636025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b17ae5-fbef-46d2-b643-10bdbb2b6364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:44.638058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b9b17ae5-fbef-46d2-b643-10bdbb2b6364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:44.700675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b17ae5-fbef-46d2-b643-10bdbb2b6364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:44.702709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b17ae5-fbef-46d2-b643-10bdbb2b6364 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:44.716395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1036/2096] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:44.772403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:45.033257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14cee1-708c-48ba-b0a5-8b0e41d09bde None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:45.033257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-eb14cee1-708c-48ba-b0a5-8b0e41d09bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:45.134917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14cee1-708c-48ba-b0a5-8b0e41d09bde None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:45.197294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:45.197919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.198196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.198467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] PATH_INFO: `/v3/projects/a6c2822f4df343a3a89ecfc9f4ab983b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.199607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c2822f4df343a3a89ecfc9f4ab983b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:45.201609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:45.278606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:45.287520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c2822f4df343a3a89ecfc9f4ab983b', 'request_id': 'req-96d76eef-6f98-4db5-9252-877645439bae'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:45.294252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c2822f4df343a3a89ecfc9f4ab983b', 'request_id': 'req-96d76eef-6f98-4db5-9252-877645439bae'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:45.300429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c2822f4df343a3a89ecfc9f4ab983b', 'request_id': 'req-96d76eef-6f98-4db5-9252-877645439bae'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:45.377080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] The token cache is being invalidate because project a6c2822f4df343a3a89ecfc9f4ab983b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:45.377365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:45.378662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-96d76eef-6f98-4db5-9252-877645439bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:45.380304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1061/2097] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:45 2022] DELETE /identity/v3/projects/a6c2822f4df343a3a89ecfc9f4ab983b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:45.385342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85c881-d730-4e43-997f-e6a946e381aa None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.385854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85c881-d730-4e43-997f-e6a946e381aa None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.385955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85c881-d730-4e43-997f-e6a946e381aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.407271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0f85c881-d730-4e43-997f-e6a946e381aa None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:45.408574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0f85c881-d730-4e43-997f-e6a946e381aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:45.479235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1037/2098] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:45.487183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03248e8-be02-4687-bf41-dddf8cc99bf6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.487565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03248e8-be02-4687-bf41-dddf8cc99bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.487842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03248e8-be02-4687-bf41-dddf8cc99bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.507669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e03248e8-be02-4687-bf41-dddf8cc99bf6 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:45.508910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e03248e8-be02-4687-bf41-dddf8cc99bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:45.517127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1062/2099] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:45.522006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85c881-d730-4e43-997f-e6a946e381aa None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:45.532994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85c881-d730-4e43-997f-e6a946e381aa None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:45.538758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:45.539374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.540672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.540672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.540672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:45.541020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:45.542634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:45.555440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1038/2100] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:45.560167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03248e8-be02-4687-bf41-dddf8cc99bf6 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:45.571489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03248e8-be02-4687-bf41-dddf8cc99bf6 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:45.576494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344853-a2df-4c1a-8146-673e44ca2657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:45.577094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344853-a2df-4c1a-8146-673e44ca2657 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.577372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344853-a2df-4c1a-8146-673e44ca2657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.577705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344853-a2df-4c1a-8146-673e44ca2657 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.578407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344853-a2df-4c1a-8146-673e44ca2657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:45.580429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344853-a2df-4c1a-8146-673e44ca2657 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:45.693967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1063/2101] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:45 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:45.698202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:45.708917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ec6b4-fbda-4fe5-ae25-f39f2f2495c8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:45.765547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3733-746f-4cd0-b8dc-634da0e4d7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:45.766070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3733-746f-4cd0-b8dc-634da0e4d7ee admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.766348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3733-746f-4cd0-b8dc-634da0e4d7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.766617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3733-746f-4cd0-b8dc-634da0e4d7ee admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.767261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d3733-746f-4cd0-b8dc-634da0e4d7ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:45.770172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d3733-746f-4cd0-b8dc-634da0e4d7ee admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:45.840705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1039/2102] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:45 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:45.844784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344853-a2df-4c1a-8146-673e44ca2657 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:45.855880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344853-a2df-4c1a-8146-673e44ca2657 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:45.860484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facba8-d421-417a-86f4-c03c65b07802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:45.861072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facba8-d421-417a-86f4-c03c65b07802 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.861350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facba8-d421-417a-86f4-c03c65b07802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.861618 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96facba8-d421-417a-86f4-c03c65b07802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.862686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96facba8-d421-417a-86f4-c03c65b07802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:45.868814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96facba8-d421-417a-86f4-c03c65b07802 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:45.874166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1064/2103] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:45.878157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3733-746f-4cd0-b8dc-634da0e4d7ee admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:45.888602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3733-746f-4cd0-b8dc-634da0e4d7ee admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:45.893924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d5496-2d6d-458f-a8df-0b00d61c021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:45.894603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d5496-2d6d-458f-a8df-0b00d61c021f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.894883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d5496-2d6d-458f-a8df-0b00d61c021f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.895155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d5496-2d6d-458f-a8df-0b00d61c021f admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.895794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d5496-2d6d-458f-a8df-0b00d61c021f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:45.897480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d5496-2d6d-458f-a8df-0b00d61c021f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:45.907268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1040/2104] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:45.911897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facba8-d421-417a-86f4-c03c65b07802 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:45.921893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96facba8-d421-417a-86f4-c03c65b07802 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:45.926993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4b1ac-1958-4ca6-abdb-b2bb491ec695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:45.927638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4b1ac-1958-4ca6-abdb-b2bb491ec695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:45.927919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4b1ac-1958-4ca6-abdb-b2bb491ec695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:45.928191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4b1ac-1958-4ca6-abdb-b2bb491ec695 admin admin] PATH_INFO: `/v3/projects/a09ba191193744fd9fd9f134a86961f9/users/0d5c75a3fb1a4466b269ea35beb8b5d7/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:45.943069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4b1ac-1958-4ca6-abdb-b2bb491ec695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09ba191193744fd9fd9f134a86961f9, user_id=0d5c75a3fb1a4466b269ea35beb8b5d7, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:45.945807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4b1ac-1958-4ca6-abdb-b2bb491ec695 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:46.023632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1065/2105] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:45 2022] PUT /identity/v3/projects/a09ba191193744fd9fd9f134a86961f9/users/0d5c75a3fb1a4466b269ea35beb8b5d7/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:46.035492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011c70-d8d5-49ae-b73b-0673a7a4f23a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:46.035776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011c70-d8d5-49ae-b73b-0673a7a4f23a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:46.036050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011c70-d8d5-49ae-b73b-0673a7a4f23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:46.070581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-da011c70-d8d5-49ae-b73b-0673a7a4f23a None None] MFA Rules not processed for user `0d5c75a3fb1a4466b269ea35beb8b5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:46.071938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da011c70-d8d5-49ae-b73b-0673a7a4f23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:46.113362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:46.158630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1041/2106] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:46.163630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4b1ac-1958-4ca6-abdb-b2bb491ec695 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:46.243290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4b1ac-1958-4ca6-abdb-b2bb491ec695 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:46.248027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b14d6f-0a6b-41fc-b24b-0438086ab29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:46.248664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b14d6f-0a6b-41fc-b24b-0438086ab29c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:46.248959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b14d6f-0a6b-41fc-b24b-0438086ab29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:46.249259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b14d6f-0a6b-41fc-b24b-0438086ab29c admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:46.249898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b14d6f-0a6b-41fc-b24b-0438086ab29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:46.251799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b14d6f-0a6b-41fc-b24b-0438086ab29c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:46.380822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1066/2107] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:46 2022] POST /identity/v3/projects => generated 399 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:46.384820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da011c70-d8d5-49ae-b73b-0673a7a4f23a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:46.405266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da011c70-d8d5-49ae-b73b-0673a7a4f23a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:46.454704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6162e-8706-4253-869b-b16af21485b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:46.455310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6162e-8706-4253-869b-b16af21485b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:46.455592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6162e-8706-4253-869b-b16af21485b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:46.455939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6162e-8706-4253-869b-b16af21485b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:46.456996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6162e-8706-4253-869b-b16af21485b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:46.458911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6162e-8706-4253-869b-b16af21485b3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:46.551622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1042/2108] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:46 2022] POST /identity/v3/users => generated 306 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:46.556247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b14d6f-0a6b-41fc-b24b-0438086ab29c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:46.568121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b14d6f-0a6b-41fc-b24b-0438086ab29c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:46.574286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75339cf-dace-4d9f-b670-5bcb1e3d4696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:46.574902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75339cf-dace-4d9f-b670-5bcb1e3d4696 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:46.575184 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75339cf-dace-4d9f-b670-5bcb1e3d4696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:46.577328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75339cf-dace-4d9f-b670-5bcb1e3d4696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:46.577328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75339cf-dace-4d9f-b670-5bcb1e3d4696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:46.577874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75339cf-dace-4d9f-b670-5bcb1e3d4696 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:46.602475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1067/2109] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:46.607118 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6162e-8706-4253-869b-b16af21485b3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:46.618126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6162e-8706-4253-869b-b16af21485b3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:46.623097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd5d1-bb05-4cb4-81ac-b6de0820db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:46.623682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd5d1-bb05-4cb4-81ac-b6de0820db70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:46.623961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd5d1-bb05-4cb4-81ac-b6de0820db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:46.624232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccd5d1-bb05-4cb4-81ac-b6de0820db70 admin admin] PATH_INFO: `/v3/projects/891ad65195324b78b0f749ff34520a12/users/b79d7c29783248c280c039a465d69659/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:46.646029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccd5d1-bb05-4cb4-81ac-b6de0820db70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891ad65195324b78b0f749ff34520a12, user_id=b79d7c29783248c280c039a465d69659, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:46.649047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccd5d1-bb05-4cb4-81ac-b6de0820db70 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:46.716362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1043/2110] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:46 2022] PUT /identity/v3/projects/891ad65195324b78b0f749ff34520a12/users/b79d7c29783248c280c039a465d69659/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:46.720216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75339cf-dace-4d9f-b670-5bcb1e3d4696 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:46.731318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75339cf-dace-4d9f-b670-5bcb1e3d4696 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:46.764061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:46.789631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897c1f2-72a4-48ce-8618-3fbbf3c7ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:46.790354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897c1f2-72a4-48ce-8618-3fbbf3c7ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:46.790640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897c1f2-72a4-48ce-8618-3fbbf3c7ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:46.790917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897c1f2-72a4-48ce-8618-3fbbf3c7ac03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:46.791567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897c1f2-72a4-48ce-8618-3fbbf3c7ac03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:46.793409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897c1f2-72a4-48ce-8618-3fbbf3c7ac03 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:46.804845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1068/2111] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:46.809423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd5d1-bb05-4cb4-81ac-b6de0820db70 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:46.820783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccd5d1-bb05-4cb4-81ac-b6de0820db70 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:46.856558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:46.856558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:46.856558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:46.856558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] PATH_INFO: `/v3/projects/891ad65195324b78b0f749ff34520a12/users/b79d7c29783248c280c039a465d69659/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:46.857008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891ad65195324b78b0f749ff34520a12, user_id=b79d7c29783248c280c039a465d69659, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:46.857008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:46.857008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1044/2112] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:46 2022] PUT /identity/v3/projects/891ad65195324b78b0f749ff34520a12/users/b79d7c29783248c280c039a465d69659/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:46.861931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618489-28a4-4986-bdcb-0cd65d304627 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:46.866444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618489-28a4-4986-bdcb-0cd65d304627 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:46.866444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618489-28a4-4986-bdcb-0cd65d304627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:46.895072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3f618489-28a4-4986-bdcb-0cd65d304627 None None] MFA Rules not processed for user `b79d7c29783248c280c039a465d69659`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:46.895072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3f618489-28a4-4986-bdcb-0cd65d304627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:46.966521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1069/2113] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:46.978409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:46.980098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:47.040031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b3176-3a07-433c-8556-4a1db1a44369 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:47.043701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b04ce-56d6-425a-ba8b-428faeaa64e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:47.044376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b04ce-56d6-425a-ba8b-428faeaa64e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:47.044651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b04ce-56d6-425a-ba8b-428faeaa64e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:47.044944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b04ce-56d6-425a-ba8b-428faeaa64e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:47.054748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b04ce-56d6-425a-ba8b-428faeaa64e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:47.058350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b04ce-56d6-425a-ba8b-428faeaa64e4 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:47.065545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1045/2114] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:47.257247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f618489-28a4-4986-bdcb-0cd65d304627 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:47.267039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f618489-28a4-4986-bdcb-0cd65d304627 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:47.271596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8d56f-c5f5-4933-ae60-e3b910e9c00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:47.272212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8d56f-c5f5-4933-ae60-e3b910e9c00a service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:47.272562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8d56f-c5f5-4933-ae60-e3b910e9c00a service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:47.272862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8d56f-c5f5-4933-ae60-e3b910e9c00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:47.343010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8d56f-c5f5-4933-ae60-e3b910e9c00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:47.344502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8d56f-c5f5-4933-ae60-e3b910e9c00a service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:47.354470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1070/2115] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:48.043654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b04ce-56d6-425a-ba8b-428faeaa64e4 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:48.054940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b04ce-56d6-425a-ba8b-428faeaa64e4 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:48.058569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8c616-cc35-4482-a7ef-7d7a19a164a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:48.059168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8c616-cc35-4482-a7ef-7d7a19a164a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:48.059444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8c616-cc35-4482-a7ef-7d7a19a164a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:48.059743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8c616-cc35-4482-a7ef-7d7a19a164a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:48.061481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8ae8c616-cc35-4482-a7ef-7d7a19a164a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:48.087180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:48.155488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8c616-cc35-4482-a7ef-7d7a19a164a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:48.158259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8c616-cc35-4482-a7ef-7d7a19a164a9 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:48.169497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1046/2116] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:52.540633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8d56f-c5f5-4933-ae60-e3b910e9c00a service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:52.600385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:52.605787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8d56f-c5f5-4933-ae60-e3b910e9c00a service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:52.610485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:52.611043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:52.611320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:52.611609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] PATH_INFO: `/v3/users/0d5c75a3fb1a4466b269ea35beb8b5d7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:52.612737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5c75a3fb1a4466b269ea35beb8b5d7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:52.614679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:52.787332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5c75a3fb1a4466b269ea35beb8b5d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:52.795200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5c75a3fb1a4466b269ea35beb8b5d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:52.807863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5c75a3fb1a4466b269ea35beb8b5d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:52.891700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5c75a3fb1a4466b269ea35beb8b5d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:52.892372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5c75a3fb1a4466b269ea35beb8b5d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:52.902284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1071/2117] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:52 2022] DELETE /identity/v3/users/0d5c75a3fb1a4466b269ea35beb8b5d7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:52.903695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2610b6-eef7-4935-9c9f-724410b8e723 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:52.904156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2610b6-eef7-4935-9c9f-724410b8e723 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:52.904244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2610b6-eef7-4935-9c9f-724410b8e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:52.929044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4d2610b6-eef7-4935-9c9f-724410b8e723 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:52.935682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4d2610b6-eef7-4935-9c9f-724410b8e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:52.993907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1047/2118] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:53.003698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:53.005146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:53.064600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c78a5f-dd0e-4b19-b780-886932c8912a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:53.068224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9408-fc4c-45cb-98e1-5ba452483c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:53.068861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9408-fc4c-45cb-98e1-5ba452483c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:53.069160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9408-fc4c-45cb-98e1-5ba452483c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:53.069396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff9408-fc4c-45cb-98e1-5ba452483c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:53.094382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9408-fc4c-45cb-98e1-5ba452483c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:53.094382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff9408-fc4c-45cb-98e1-5ba452483c6c service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:53.118556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1072/2119] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:53.545549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2610b6-eef7-4935-9c9f-724410b8e723 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:53.547028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4d2610b6-eef7-4935-9c9f-724410b8e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:53.559971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2610b6-eef7-4935-9c9f-724410b8e723 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:53.564702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:53.565341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:53.565618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:53.565891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] PATH_INFO: `/v3/projects/a09ba191193744fd9fd9f134a86961f9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:53.567041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09ba191193744fd9fd9f134a86961f9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:53.569011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:53.703202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09ba191193744fd9fd9f134a86961f9', 'request_id': 'req-393e1a0a-2693-4f4e-b180-cc3e4b69be83'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:53.782936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09ba191193744fd9fd9f134a86961f9', 'request_id': 'req-393e1a0a-2693-4f4e-b180-cc3e4b69be83'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:53.790181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09ba191193744fd9fd9f134a86961f9', 'request_id': 'req-393e1a0a-2693-4f4e-b180-cc3e4b69be83'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:53.801574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] The token cache is being invalidate because project a09ba191193744fd9fd9f134a86961f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:53.802100 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:53.802388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:53.804166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1048/2120] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:53 2022] DELETE /identity/v3/projects/a09ba191193744fd9fd9f134a86961f9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:53.808012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9408-fc4c-45cb-98e1-5ba452483c6c service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:53.818204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff9408-fc4c-45cb-98e1-5ba452483c6c service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:53.880394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:53.881017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:53.881298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:53.881596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] PATH_INFO: `/v3/users/b79d7c29783248c280c039a465d69659` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:53.882738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79d7c29783248c280c039a465d69659)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:53.884901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:53.906094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:54.099454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79d7c29783248c280c039a465d69659'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:54.107629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79d7c29783248c280c039a465d69659'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:54.120279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79d7c29783248c280c039a465d69659'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:54.187513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79d7c29783248c280c039a465d69659'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:54.188177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6738d8ee-7ab8-48ec-88a5-0aeaa31b7250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79d7c29783248c280c039a465d69659'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:54.195234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1073/2121] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:53 2022] DELETE /identity/v3/users/b79d7c29783248c280c039a465d69659 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:54.682182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:54.683694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:54.696935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1a0a-2693-4f4e-b180-cc3e4b69be83 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:54.738222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:54.760708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:54.761461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:54.761610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:54.761877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] PATH_INFO: `/v3/projects/891ad65195324b78b0f749ff34520a12` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:54.763434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891ad65195324b78b0f749ff34520a12)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:54.765763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:54.872024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891ad65195324b78b0f749ff34520a12', 'request_id': 'req-059dc04a-9fea-4cd3-b702-73ba2b6857b2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:54.966225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891ad65195324b78b0f749ff34520a12', 'request_id': 'req-059dc04a-9fea-4cd3-b702-73ba2b6857b2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:54.974520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891ad65195324b78b0f749ff34520a12', 'request_id': 'req-059dc04a-9fea-4cd3-b702-73ba2b6857b2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:54.998473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] The token cache is being invalidate because project 891ad65195324b78b0f749ff34520a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:54.998765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:55.000611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-059dc04a-9fea-4cd3-b702-73ba2b6857b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:55.011700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945039d-abee-427a-9293-94b37cd42f91 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.012226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945039d-abee-427a-9293-94b37cd42f91 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.012912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945039d-abee-427a-9293-94b37cd42f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.016023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1049/2122] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:54 2022] DELETE /identity/v3/projects/891ad65195324b78b0f749ff34520a12 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:55.035988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0945039d-abee-427a-9293-94b37cd42f91 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:55.037512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0945039d-abee-427a-9293-94b37cd42f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:55.111032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1074/2123] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:55.120155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec645-4edf-4d36-9319-89118ed75284 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.120543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec645-4edf-4d36-9319-89118ed75284 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.120819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec645-4edf-4d36-9319-89118ed75284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.142258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c22ec645-4edf-4d36-9319-89118ed75284 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:55.143473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c22ec645-4edf-4d36-9319-89118ed75284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:55.153529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1050/2124] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:55.157456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945039d-abee-427a-9293-94b37cd42f91 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:55.168637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945039d-abee-427a-9293-94b37cd42f91 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:55.174760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1598a6-9e42-42fc-9767-e583e0727ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:55.175409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1598a6-9e42-42fc-9767-e583e0727ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.175688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1598a6-9e42-42fc-9767-e583e0727ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.175961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1598a6-9e42-42fc-9767-e583e0727ec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.176898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1598a6-9e42-42fc-9767-e583e0727ec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:55.179214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1598a6-9e42-42fc-9767-e583e0727ec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:55.179214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1598a6-9e42-42fc-9767-e583e0727ec2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:55.191184 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1075/2125] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:26:55.196467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec645-4edf-4d36-9319-89118ed75284 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:55.206517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec645-4edf-4d36-9319-89118ed75284 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:55.209918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c0de-e81a-4cb7-8f62-faac0b7bda8b None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.211412 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c0de-e81a-4cb7-8f62-faac0b7bda8b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.211978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49c0de-e81a-4cb7-8f62-faac0b7bda8b None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.213758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5a3e-631a-40fc-84ff-b888b1e35926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:55.214138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1076/2126] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:26:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:26:55.214368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5a3e-631a-40fc-84ff-b888b1e35926 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.214642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5a3e-631a-40fc-84ff-b888b1e35926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.214909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5a3e-631a-40fc-84ff-b888b1e35926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.215589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5a3e-631a-40fc-84ff-b888b1e35926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:55.217516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5a3e-631a-40fc-84ff-b888b1e35926 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:55.245058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040105d-9575-4359-bd68-5d00e6b6deaf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.245344 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040105d-9575-4359-bd68-5d00e6b6deaf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.245624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040105d-9575-4359-bd68-5d00e6b6deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.267590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8040105d-9575-4359-bd68-5d00e6b6deaf None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:55.268763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8040105d-9575-4359-bd68-5d00e6b6deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:55.335348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1051/2127] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:55 2022] POST /identity/v3/projects => generated 389 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:55.335577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1077/2128] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:55.336368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5a3e-631a-40fc-84ff-b888b1e35926 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:55.347505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3eafa-cb4f-4b80-89c3-cea901155120 None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.347955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3eafa-cb4f-4b80-89c3-cea901155120 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.348237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3eafa-cb4f-4b80-89c3-cea901155120 None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.349575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1078/2129] 10.222.0.27 () {54 vars in 961 bytes} [Sun Aug 28 10:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 10:26:55.354717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910145bd-2bb6-4b36-bb08-9fb01107c7f8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.355001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910145bd-2bb6-4b36-bb08-9fb01107c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.355277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910145bd-2bb6-4b36-bb08-9fb01107c7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.377331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-910145bd-2bb6-4b36-bb08-9fb01107c7f8 None None] MFA Rules not processed for user `d36276f9c3f840e881d15ece72a94d07`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:55.379050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-910145bd-2bb6-4b36-bb08-9fb01107c7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:55.394589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:55.414106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5a3e-631a-40fc-84ff-b888b1e35926 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:55.419480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d623f6-71d5-460d-a884-f265c1edb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:55.420087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d623f6-71d5-460d-a884-f265c1edb6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.420414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d623f6-71d5-460d-a884-f265c1edb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.420700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d623f6-71d5-460d-a884-f265c1edb6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.421422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d623f6-71d5-460d-a884-f265c1edb6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:55.423502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d623f6-71d5-460d-a884-f265c1edb6b4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:55.451639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1079/2130] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 28 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:55.459468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910145bd-2bb6-4b36-bb08-9fb01107c7f8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:55.469395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910145bd-2bb6-4b36-bb08-9fb01107c7f8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:55.474982 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f64f0-d830-4b9b-bb75-e4232ba1af56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:55.475610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f64f0-d830-4b9b-bb75-e4232ba1af56 service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.475990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f64f0-d830-4b9b-bb75-e4232ba1af56 service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.476371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f64f0-d830-4b9b-bb75-e4232ba1af56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.486355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f64f0-d830-4b9b-bb75-e4232ba1af56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:55.487063 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f64f0-d830-4b9b-bb75-e4232ba1af56 service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:55.500760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1080/2131] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:55.512193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1052/2132] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:55 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:55.517483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f64f0-d830-4b9b-bb75-e4232ba1af56 service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:55.530190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f64f0-d830-4b9b-bb75-e4232ba1af56 service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:55.541545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43056951-fc81-4092-9795-8b782da8c985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:55.541545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43056951-fc81-4092-9795-8b782da8c985 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.541545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43056951-fc81-4092-9795-8b782da8c985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.541545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43056951-fc81-4092-9795-8b782da8c985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.541884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43056951-fc81-4092-9795-8b782da8c985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:55.541884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43056951-fc81-4092-9795-8b782da8c985 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:55.553519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1081/2133] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:55.557776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d623f6-71d5-460d-a884-f265c1edb6b4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:55.571049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d623f6-71d5-460d-a884-f265c1edb6b4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:55.575949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d81a2d-5985-42b1-ab6e-5106ba15e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:55.577173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81a2d-5985-42b1-ab6e-5106ba15e5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.577173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81a2d-5985-42b1-ab6e-5106ba15e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.577173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81a2d-5985-42b1-ab6e-5106ba15e5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.577779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d81a2d-5985-42b1-ab6e-5106ba15e5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:55.579411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d81a2d-5985-42b1-ab6e-5106ba15e5ad admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:55.593632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1053/2134] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:55.594584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43056951-fc81-4092-9795-8b782da8c985 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:55.605186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43056951-fc81-4092-9795-8b782da8c985 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:55.610243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87db32-c252-4ae8-8f0e-8bf15bc90ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:55.610901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87db32-c252-4ae8-8f0e-8bf15bc90ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.611203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87db32-c252-4ae8-8f0e-8bf15bc90ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.611482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87db32-c252-4ae8-8f0e-8bf15bc90ff8 admin admin] PATH_INFO: `/v3/projects/f5fb79d447f2419c97f64ba3a9a43191/users/590a39cf582a4e99a65b6497c2ed8dff/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.627319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87db32-c252-4ae8-8f0e-8bf15bc90ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fb79d447f2419c97f64ba3a9a43191, user_id=590a39cf582a4e99a65b6497c2ed8dff, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:55.630168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87db32-c252-4ae8-8f0e-8bf15bc90ff8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:55.714549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1082/2135] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:55 2022] PUT /identity/v3/projects/f5fb79d447f2419c97f64ba3a9a43191/users/590a39cf582a4e99a65b6497c2ed8dff/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:55.724822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97227d-c486-47e0-92bb-1bc39641e4d3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.725341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97227d-c486-47e0-92bb-1bc39641e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.725500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97227d-c486-47e0-92bb-1bc39641e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.760586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3e97227d-c486-47e0-92bb-1bc39641e4d3 None None] MFA Rules not processed for user `590a39cf582a4e99a65b6497c2ed8dff`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:55.761826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e97227d-c486-47e0-92bb-1bc39641e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:55.842687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1054/2136] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:55.843851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87db32-c252-4ae8-8f0e-8bf15bc90ff8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:55.892198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:55.909990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87db32-c252-4ae8-8f0e-8bf15bc90ff8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:55.915364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:55.915972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:55.916250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:55.919626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:55.919626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:55.919626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.002992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1083/2137] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:55 2022] POST /identity/v3/projects => generated 389 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:56.007174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97227d-c486-47e0-92bb-1bc39641e4d3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:56.019175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97227d-c486-47e0-92bb-1bc39641e4d3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:56.081166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d1c8-7504-477a-8559-ecad6efd515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:56.081928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d1c8-7504-477a-8559-ecad6efd515e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.082213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d1c8-7504-477a-8559-ecad6efd515e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.082479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d1c8-7504-477a-8559-ecad6efd515e admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.083125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d1c8-7504-477a-8559-ecad6efd515e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:56.085689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d1c8-7504-477a-8559-ecad6efd515e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.132135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:56.134253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:56.149394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a648-da95-4a6b-817f-ac36e86b5221 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:56.154862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:56.155519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.155800 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.156074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] PATH_INFO: `/v3/users/176deac4b617427b9d49d352787732d5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.157239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=176deac4b617427b9d49d352787732d5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:56.159214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.195009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1055/2138] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:56 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:26:56.199057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d1c8-7504-477a-8559-ecad6efd515e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:56.208638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d1c8-7504-477a-8559-ecad6efd515e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:56.213957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f270b-3198-4f92-93c0-f4fb748bde71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:56.214550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f270b-3198-4f92-93c0-f4fb748bde71 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.214831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f270b-3198-4f92-93c0-f4fb748bde71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.215109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f270b-3198-4f92-93c0-f4fb748bde71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.215785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f270b-3198-4f92-93c0-f4fb748bde71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:56.217415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f270b-3198-4f92-93c0-f4fb748bde71 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.227973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1056/2139] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:56.231853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f270b-3198-4f92-93c0-f4fb748bde71 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:56.241317 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f270b-3198-4f92-93c0-f4fb748bde71 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:56.246395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0166b-6f7e-4fad-b2af-32327ac78f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:56.247021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0166b-6f7e-4fad-b2af-32327ac78f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.247305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0166b-6f7e-4fad-b2af-32327ac78f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.249516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0166b-6f7e-4fad-b2af-32327ac78f52 admin admin] PATH_INFO: `/v3/projects/a5bc1fab127948398b543a476ec2e1c1/users/4ce11ce2b09c49748f85bdf12d7473cd/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.262002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0166b-6f7e-4fad-b2af-32327ac78f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5bc1fab127948398b543a476ec2e1c1, user_id=4ce11ce2b09c49748f85bdf12d7473cd, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:56.264963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0166b-6f7e-4fad-b2af-32327ac78f52 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.367934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176deac4b617427b9d49d352787732d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:56.374616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176deac4b617427b9d49d352787732d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:56.384929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:56.389547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176deac4b617427b9d49d352787732d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:56.389767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1057/2140] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:56 2022] PUT /identity/v3/projects/a5bc1fab127948398b543a476ec2e1c1/users/4ce11ce2b09c49748f85bdf12d7473cd/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:56.393738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0166b-6f7e-4fad-b2af-32327ac78f52 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:56.462566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0166b-6f7e-4fad-b2af-32327ac78f52 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:56.467447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5475b-e779-4d5b-a5e1-844f78a92a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:56.468392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5475b-e779-4d5b-a5e1-844f78a92a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.468504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5475b-e779-4d5b-a5e1-844f78a92a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.469375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5475b-e779-4d5b-a5e1-844f78a92a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.469486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176deac4b617427b9d49d352787732d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:56.469582 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5475b-e779-4d5b-a5e1-844f78a92a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:56.470340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176deac4b617427b9d49d352787732d5'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:56.471318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5475b-e779-4d5b-a5e1-844f78a92a94 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.477657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1084/2141] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:56 2022] DELETE /identity/v3/users/176deac4b617427b9d49d352787732d5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:56.482387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1058/2142] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:56.486481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:56.488065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:56.565736 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ddaae-6991-42ec-a456-d0d6c43b4af4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:56.571457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:56.572127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.572441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.572907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] PATH_INFO: `/v3/projects/a5bc1fab127948398b543a476ec2e1c1/users/4ce11ce2b09c49748f85bdf12d7473cd/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.575338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5bc1fab127948398b543a476ec2e1c1, user_id=4ce11ce2b09c49748f85bdf12d7473cd, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:56.578338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.590459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1085/2143] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:56 2022] PUT /identity/v3/projects/a5bc1fab127948398b543a476ec2e1c1/users/4ce11ce2b09c49748f85bdf12d7473cd/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:56.605829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf5753-b596-4090-80f8-047a675369f9 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.606112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf5753-b596-4090-80f8-047a675369f9 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.609448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf5753-b596-4090-80f8-047a675369f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.643976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-03cf5753-b596-4090-80f8-047a675369f9 None None] MFA Rules not processed for user `4ce11ce2b09c49748f85bdf12d7473cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:56.643976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-03cf5753-b596-4090-80f8-047a675369f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:56.723058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1059/2144] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:56 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:56.736103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:56.737975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:56.803501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf5753-b596-4090-80f8-047a675369f9 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:56.806177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-03cf5753-b596-4090-80f8-047a675369f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:56.812729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7f21-1808-4749-a434-7ad1c0398bdd admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:56.818514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cba4-37c0-4af8-b576-00e69fab40db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:56.819222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cba4-37c0-4af8-b576-00e69fab40db service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.819616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cba4-37c0-4af8-b576-00e69fab40db service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.819967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cba4-37c0-4af8-b576-00e69fab40db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.833482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08cba4-37c0-4af8-b576-00e69fab40db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:56.839073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08cba4-37c0-4af8-b576-00e69fab40db service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.871844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1086/2145] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:56.887696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf5753-b596-4090-80f8-047a675369f9 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:56.892457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:56.893232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:56.898214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:56.898214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] PATH_INFO: `/v3/projects/507ec339e2b248c9b7ad367fcb6b2b0a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:56.898214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507ec339e2b248c9b7ad367fcb6b2b0a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:56.898214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:56.911025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:56.996482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507ec339e2b248c9b7ad367fcb6b2b0a', 'request_id': 'req-0d3c21c9-473a-4220-a642-b0a07365b798'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.017992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cba4-37c0-4af8-b576-00e69fab40db service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:57.029118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cba4-37c0-4af8-b576-00e69fab40db service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:57.056446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507ec339e2b248c9b7ad367fcb6b2b0a', 'request_id': 'req-0d3c21c9-473a-4220-a642-b0a07365b798'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.063438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507ec339e2b248c9b7ad367fcb6b2b0a', 'request_id': 'req-0d3c21c9-473a-4220-a642-b0a07365b798'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.076973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] The token cache is being invalidate because project 507ec339e2b248c9b7ad367fcb6b2b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:57.077389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.078338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.079879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1060/2146] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:56 2022] DELETE /identity/v3/projects/507ec339e2b248c9b7ad367fcb6b2b0a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:57.084197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:57.086226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:57.089192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:57.089834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:57.090123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:57.090395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] PATH_INFO: `/v3/users/590a39cf582a4e99a65b6497c2ed8dff` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:57.091549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=590a39cf582a4e99a65b6497c2ed8dff)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:57.093524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:57.099732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c21c9-473a-4220-a642-b0a07365b798 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:57.105109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:57.105739 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:57.106022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:57.106467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] PATH_INFO: `/v3/users/f715d12a956c45979237f14e229578d4` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:57.107528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f715d12a956c45979237f14e229578d4)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:57.109518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:57.353779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f715d12a956c45979237f14e229578d4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.359407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590a39cf582a4e99a65b6497c2ed8dff'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.362119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f715d12a956c45979237f14e229578d4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.366966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590a39cf582a4e99a65b6497c2ed8dff'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.379239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590a39cf582a4e99a65b6497c2ed8dff'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.479389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f715d12a956c45979237f14e229578d4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.492033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f715d12a956c45979237f14e229578d4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.492881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0ada73d-5434-47f8-8b34-f72ff53c57cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f715d12a956c45979237f14e229578d4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.498684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1061/2147] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:57 2022] DELETE /identity/v3/users/f715d12a956c45979237f14e229578d4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:57.504261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:57.526914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590a39cf582a4e99a65b6497c2ed8dff'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.527551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590a39cf582a4e99a65b6497c2ed8dff'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:57.534608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1087/2148] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:57 2022] DELETE /identity/v3/users/590a39cf582a4e99a65b6497c2ed8dff => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:57.538996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7b75-cae4-413a-82de-58e0638c6141 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:57.539278 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7b75-cae4-413a-82de-58e0638c6141 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:57.539550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7b75-cae4-413a-82de-58e0638c6141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:57.567340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-280b7b75-cae4-413a-82de-58e0638c6141 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:57.568600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-280b7b75-cae4-413a-82de-58e0638c6141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:57.638328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1062/2149] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:57.646322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:57.647849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:57.707772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9862d-f87e-4662-b429-ed3215d828cc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:57.711325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195249c-6cc3-4dd6-842f-10771078fce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:57.711933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195249c-6cc3-4dd6-842f-10771078fce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:57.712219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195249c-6cc3-4dd6-842f-10771078fce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:57.712526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195249c-6cc3-4dd6-842f-10771078fce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:57.721331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195249c-6cc3-4dd6-842f-10771078fce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:57.722749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195249c-6cc3-4dd6-842f-10771078fce3 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:57.731960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1088/2150] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:57.778529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:57.787689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b7b75-cae4-413a-82de-58e0638c6141 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:57.789382 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-280b7b75-cae4-413a-82de-58e0638c6141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:57.814303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b7b75-cae4-413a-82de-58e0638c6141 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:57.826684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:57.827492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:57.827903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:57.828353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] PATH_INFO: `/v3/projects/9a5a009f62634786afebd2c1d7bd2ed1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:57.833084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5a009f62634786afebd2c1d7bd2ed1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:57.833741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:57.936734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5a009f62634786afebd2c1d7bd2ed1', 'request_id': 'req-46179734-56e4-432e-b496-9e3160005ddc'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.034735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5a009f62634786afebd2c1d7bd2ed1', 'request_id': 'req-46179734-56e4-432e-b496-9e3160005ddc'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.043422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5a009f62634786afebd2c1d7bd2ed1', 'request_id': 'req-46179734-56e4-432e-b496-9e3160005ddc'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.060996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] The token cache is being invalidate because project 9a5a009f62634786afebd2c1d7bd2ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:58.061614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.067917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-46179734-56e4-432e-b496-9e3160005ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.067917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1063/2151] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:57 2022] DELETE /identity/v3/projects/9a5a009f62634786afebd2c1d7bd2ed1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:58.075275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a589b3-4292-49f1-a014-cf3e8c8510ca None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.075792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a589b3-4292-49f1-a014-cf3e8c8510ca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.076252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a589b3-4292-49f1-a014-cf3e8c8510ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.099078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-74a589b3-4292-49f1-a014-cf3e8c8510ca None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:58.101706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-74a589b3-4292-49f1-a014-cf3e8c8510ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:58.170739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1089/2152] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:58.179720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf5d4-39ee-499a-9024-60346495cb6d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.180120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf5d4-39ee-499a-9024-60346495cb6d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.180525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf5d4-39ee-499a-9024-60346495cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.200809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-18acf5d4-39ee-499a-9024-60346495cb6d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:58.202077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-18acf5d4-39ee-499a-9024-60346495cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:58.210782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1064/2153] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:26:58.216067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a589b3-4292-49f1-a014-cf3e8c8510ca None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:58.228858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a589b3-4292-49f1-a014-cf3e8c8510ca None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:58.231075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf5d4-39ee-499a-9024-60346495cb6d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:58.233269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:58.233419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-18acf5d4-39ee-499a-9024-60346495cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:58.233855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.234133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.234400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.235116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:58.235434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:58.237167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:58.254197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1090/2154] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:26:58.259291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:58.260158 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf5d4-39ee-499a-9024-60346495cb6d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:58.267043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:58.270188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.270776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.271492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] PATH_INFO: `/v3/projects/f5fb79d447f2419c97f64ba3a9a43191` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.274324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cae6-7dcf-46dd-aa84-8e78285db313 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:58.274741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fb79d447f2419c97f64ba3a9a43191)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:58.277433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:58.280640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52406e8-b9f3-45c2-9d58-dfa815d1b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:58.281254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52406e8-b9f3-45c2-9d58-dfa815d1b910 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.281553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52406e8-b9f3-45c2-9d58-dfa815d1b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.281917 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52406e8-b9f3-45c2-9d58-dfa815d1b910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.282410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52406e8-b9f3-45c2-9d58-dfa815d1b910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:58.284479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52406e8-b9f3-45c2-9d58-dfa815d1b910 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:58.407968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1091/2155] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:58 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:58.411836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52406e8-b9f3-45c2-9d58-dfa815d1b910 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:58.424994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fb79d447f2419c97f64ba3a9a43191', 'request_id': 'req-69015243-1586-4a93-8bcb-d97c4a895e53'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.474936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52406e8-b9f3-45c2-9d58-dfa815d1b910 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:58.482802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:58.482802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.482802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.482802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.483195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:58.484248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:58.502538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fb79d447f2419c97f64ba3a9a43191', 'request_id': 'req-69015243-1586-4a93-8bcb-d97c4a895e53'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.509646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fb79d447f2419c97f64ba3a9a43191', 'request_id': 'req-69015243-1586-4a93-8bcb-d97c4a895e53'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.520541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] The token cache is being invalidate because project f5fb79d447f2419c97f64ba3a9a43191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:58.520834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.521539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.523871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1065/2156] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:58 2022] DELETE /identity/v3/projects/f5fb79d447f2419c97f64ba3a9a43191 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:58.527480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:58.528918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:58.583091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1092/2157] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:26:58 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:26:58.587963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:58.589868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:58.594828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69015243-1586-4a93-8bcb-d97c4a895e53 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:58.599653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:58.600428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.601330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.601827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] PATH_INFO: `/v3/users/4ce11ce2b09c49748f85bdf12d7473cd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.602856 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e238b-4420-4b12-b53b-305d36d28a35 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:58.603248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce11ce2b09c49748f85bdf12d7473cd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:58.605350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:58.607548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744d45-2bfe-49a0-b23e-bf659719e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:58.608155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744d45-2bfe-49a0-b23e-bf659719e96f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.608483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744d45-2bfe-49a0-b23e-bf659719e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.608753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744d45-2bfe-49a0-b23e-bf659719e96f admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.609402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744d45-2bfe-49a0-b23e-bf659719e96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:58.610985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744d45-2bfe-49a0-b23e-bf659719e96f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:58.622464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1093/2158] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:26:58.626416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744d45-2bfe-49a0-b23e-bf659719e96f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:58.636815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744d45-2bfe-49a0-b23e-bf659719e96f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:58.642161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f95a-5fb2-4829-9787-93bc5f305bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:58.642787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f95a-5fb2-4829-9787-93bc5f305bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.643076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f95a-5fb2-4829-9787-93bc5f305bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.643406 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f95a-5fb2-4829-9787-93bc5f305bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.644095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53f95a-5fb2-4829-9787-93bc5f305bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:58.645805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53f95a-5fb2-4829-9787-93bc5f305bc4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:58.657915 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1094/2159] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:26:58.662119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f95a-5fb2-4829-9787-93bc5f305bc4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:58.671514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f95a-5fb2-4829-9787-93bc5f305bc4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:58.676231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91633ca-2ec3-498f-b006-fb1b83dbd59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:58.680130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91633ca-2ec3-498f-b006-fb1b83dbd59b admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.680130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91633ca-2ec3-498f-b006-fb1b83dbd59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.680130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91633ca-2ec3-498f-b006-fb1b83dbd59b admin admin] PATH_INFO: `/v3/projects/1c6216665d164b77ace50efbe12e01cf/users/0ccf3f2d9bdb4d06a4cba86af70732d5/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.691713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91633ca-2ec3-498f-b006-fb1b83dbd59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6216665d164b77ace50efbe12e01cf, user_id=0ccf3f2d9bdb4d06a4cba86af70732d5, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:58.694932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91633ca-2ec3-498f-b006-fb1b83dbd59b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:58.703129 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:58.777678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1095/2160] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:26:58 2022] PUT /identity/v3/projects/1c6216665d164b77ace50efbe12e01cf/users/0ccf3f2d9bdb4d06a4cba86af70732d5/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:58.787692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16c45-6ae8-4cae-9067-7cc82fc361c2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:58.788003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16c45-6ae8-4cae-9067-7cc82fc361c2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:58.788277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e16c45-6ae8-4cae-9067-7cc82fc361c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:58.803021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce11ce2b09c49748f85bdf12d7473cd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.811414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce11ce2b09c49748f85bdf12d7473cd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.820218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-93e16c45-6ae8-4cae-9067-7cc82fc361c2 None None] MFA Rules not processed for user `0ccf3f2d9bdb4d06a4cba86af70732d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:58.821532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-93e16c45-6ae8-4cae-9067-7cc82fc361c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:58.868103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:26:58.890252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1096/2161] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:58.896329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce11ce2b09c49748f85bdf12d7473cd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.910034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce11ce2b09c49748f85bdf12d7473cd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.910957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce11ce2b09c49748f85bdf12d7473cd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:58.917298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1066/2162] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:58 2022] DELETE /identity/v3/users/4ce11ce2b09c49748f85bdf12d7473cd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:59.055318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16c45-6ae8-4cae-9067-7cc82fc361c2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:59.063169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-93e16c45-6ae8-4cae-9067-7cc82fc361c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.114874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e16c45-6ae8-4cae-9067-7cc82fc361c2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:59.175186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:59.182616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.182616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.182616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.182616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.258595 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:59.260181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:59.271707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1097/2163] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:26:59.296615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:59.298165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.372054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4818e-93f1-4d2c-a722-4a25ac1db144 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:59.374270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:59.374912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.375195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.375472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] PATH_INFO: `/v3/users/0ccf3f2d9bdb4d06a4cba86af70732d5` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.376689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccf3f2d9bdb4d06a4cba86af70732d5)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:59.378681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:59.470461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:59.471960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.489774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c959a7-4ecd-4cf6-95fc-450e334df1cd service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:59.495203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:59.495842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.496126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.496439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] PATH_INFO: `/v3/projects/a5bc1fab127948398b543a476ec2e1c1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.497577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5bc1fab127948398b543a476ec2e1c1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:59.499624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:59.562590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccf3f2d9bdb4d06a4cba86af70732d5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.569241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccf3f2d9bdb4d06a4cba86af70732d5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.668517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5bc1fab127948398b543a476ec2e1c1', 'request_id': 'req-4998fea2-127e-4ebb-91c8-300e6df0cdc6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.674455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccf3f2d9bdb4d06a4cba86af70732d5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.674696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5bc1fab127948398b543a476ec2e1c1', 'request_id': 'req-4998fea2-127e-4ebb-91c8-300e6df0cdc6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.681037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5bc1fab127948398b543a476ec2e1c1', 'request_id': 'req-4998fea2-127e-4ebb-91c8-300e6df0cdc6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.689421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccf3f2d9bdb4d06a4cba86af70732d5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.690212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b3afcd3a-e9e7-433e-9d2d-bf67ae4246d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccf3f2d9bdb4d06a4cba86af70732d5'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.696857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1067/2164] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:26:59 2022] DELETE /identity/v3/users/0ccf3f2d9bdb4d06a4cba86af70732d5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:26:59.701337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe18765-6787-4333-a84d-804de3af4750 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.701845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe18765-6787-4333-a84d-804de3af4750 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.702225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe18765-6787-4333-a84d-804de3af4750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.722273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9fe18765-6787-4333-a84d-804de3af4750 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:59.723463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9fe18765-6787-4333-a84d-804de3af4750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.777329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] The token cache is being invalidate because project a5bc1fab127948398b543a476ec2e1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:26:59.777616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.778230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4998fea2-127e-4ebb-91c8-300e6df0cdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:26:59.779755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1098/2165] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:26:59 2022] DELETE /identity/v3/projects/a5bc1fab127948398b543a476ec2e1c1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:26:59.782538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1068/2166] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:59.784666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3308f-dd99-4bb5-8a2c-7fc4c531bba7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.784954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3308f-dd99-4bb5-8a2c-7fc4c531bba7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.785311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3308f-dd99-4bb5-8a2c-7fc4c531bba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.792781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe18765-6787-4333-a84d-804de3af4750 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:59.794185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9fe18765-6787-4333-a84d-804de3af4750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.811530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-07f3308f-dd99-4bb5-8a2c-7fc4c531bba7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:59.812844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-07f3308f-dd99-4bb5-8a2c-7fc4c531bba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.821042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1099/2167] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:59.829325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb74d-7bce-48e0-9aad-4b303aec781a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.829325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb74d-7bce-48e0-9aad-4b303aec781a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.829325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbb74d-7bce-48e0-9aad-4b303aec781a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.848880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b2dbb74d-7bce-48e0-9aad-4b303aec781a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:26:59.850089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b2dbb74d-7bce-48e0-9aad-4b303aec781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.853440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe18765-6787-4333-a84d-804de3af4750 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:59.857119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:59.857726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.858007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.858282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.858709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1100/2168] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:26:59.860496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:26:59.862785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbb74d-7bce-48e0-9aad-4b303aec781a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:59.872040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbb74d-7bce-48e0-9aad-4b303aec781a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:59.873960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:59.875870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:59.876537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:59.877202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.877516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.877795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.878501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:26:59.878852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:59.880644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:26:59.885651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1069/2169] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:26:59.893038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1101/2170] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:26:59.898005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:26:59.907772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947fb6a-b6e3-49f4-a7f8-4feaf8bb99f1 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:26:59.912870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c58d9-11c3-41c4-a084-89d225cbc607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:26:59.914571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c58d9-11c3-41c4-a084-89d225cbc607 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:26:59.914969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c58d9-11c3-41c4-a084-89d225cbc607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:26:59.915305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c58d9-11c3-41c4-a084-89d225cbc607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:26:59.915958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c58d9-11c3-41c4-a084-89d225cbc607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:26:59.917901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c58d9-11c3-41c4-a084-89d225cbc607 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.042463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1070/2171] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:26:59 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:00.046642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.056691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ca744-5d37-4529-8f4f-28eccae1f63a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.120502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:00.142970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b020c0-c1e9-45b8-bdea-611de1010527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.143616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b020c0-c1e9-45b8-bdea-611de1010527 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.143916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b020c0-c1e9-45b8-bdea-611de1010527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.144177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b020c0-c1e9-45b8-bdea-611de1010527 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.144876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b020c0-c1e9-45b8-bdea-611de1010527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.146916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b020c0-c1e9-45b8-bdea-611de1010527 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.239294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1102/2172] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:00 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:00.243415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c58d9-11c3-41c4-a084-89d225cbc607 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.253720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c58d9-11c3-41c4-a084-89d225cbc607 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.259948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3d3f8-786b-4daa-bdd7-3324477e10a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.259948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3d3f8-786b-4daa-bdd7-3324477e10a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.260143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3d3f8-786b-4daa-bdd7-3324477e10a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.260351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3d3f8-786b-4daa-bdd7-3324477e10a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.261062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3d3f8-786b-4daa-bdd7-3324477e10a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.262981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3d3f8-786b-4daa-bdd7-3324477e10a1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.274284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1071/2173] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:00.278485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b020c0-c1e9-45b8-bdea-611de1010527 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.279418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:00.289215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b020c0-c1e9-45b8-bdea-611de1010527 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.294044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.294750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.295101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.295448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.296182 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.297990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.308958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1103/2174] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:00.313711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3d3f8-786b-4daa-bdd7-3324477e10a1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.316946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.328212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3d3f8-786b-4daa-bdd7-3324477e10a1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.337868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:00.353394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a68b03-645d-44ba-8560-e3dc2390992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.354088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68b03-645d-44ba-8560-e3dc2390992c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.354401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68b03-645d-44ba-8560-e3dc2390992c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.354691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f6a50-4a25-43ec-bf10-dedaed7ed897 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.358097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a68b03-645d-44ba-8560-e3dc2390992c admin admin] PATH_INFO: `/v3/projects/9be1b87fc90c4a74bcb47eb9f4bbe799/users/ffd946c39b3e4cfb9792c86e0fb22e8c/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.359895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.360671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.361071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.361456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] PATH_INFO: `/v3/projects/1c6216665d164b77ace50efbe12e01cf` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.362723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6216665d164b77ace50efbe12e01cf)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.364927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.376520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68b03-645d-44ba-8560-e3dc2390992c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be1b87fc90c4a74bcb47eb9f4bbe799, user_id=ffd946c39b3e4cfb9792c86e0fb22e8c, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.379327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a68b03-645d-44ba-8560-e3dc2390992c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.486128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1072/2175] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:00 2022] PUT /identity/v3/projects/9be1b87fc90c4a74bcb47eb9f4bbe799/users/ffd946c39b3e4cfb9792c86e0fb22e8c/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:00.496979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed287-1a04-44ae-b947-5abbe3ae67b7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.497259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed287-1a04-44ae-b947-5abbe3ae67b7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.497530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed287-1a04-44ae-b947-5abbe3ae67b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.526470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f86ed287-1a04-44ae-b947-5abbe3ae67b7 None None] MFA Rules not processed for user `ffd946c39b3e4cfb9792c86e0fb22e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:00.527801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f86ed287-1a04-44ae-b947-5abbe3ae67b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:00.540572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6216665d164b77ace50efbe12e01cf', 'request_id': 'req-3149e5ec-b229-4a25-b2bc-f6e081ac676b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:00.548360 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6216665d164b77ace50efbe12e01cf', 'request_id': 'req-3149e5ec-b229-4a25-b2bc-f6e081ac676b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:00.555719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6216665d164b77ace50efbe12e01cf', 'request_id': 'req-3149e5ec-b229-4a25-b2bc-f6e081ac676b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:00.618594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1073/2176] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:00.623063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed287-1a04-44ae-b947-5abbe3ae67b7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.656706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] The token cache is being invalidate because project 1c6216665d164b77ace50efbe12e01cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:00.657003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:00.657647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3149e5ec-b229-4a25-b2bc-f6e081ac676b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:00.659436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1104/2177] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:00 2022] DELETE /identity/v3/projects/1c6216665d164b77ace50efbe12e01cf => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:00.664423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d74a9-7210-4d17-8aa7-03ff0649e0bf None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.664706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d74a9-7210-4d17-8aa7-03ff0649e0bf None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.664978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d74a9-7210-4d17-8aa7-03ff0649e0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.684229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2c5d74a9-7210-4d17-8aa7-03ff0649e0bf None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:00.685440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2c5d74a9-7210-4d17-8aa7-03ff0649e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:00.688867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed287-1a04-44ae-b947-5abbe3ae67b7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.693236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1105/2178] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:00.693476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.694152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.695005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.695278 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.698544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.700563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.702673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3920-5623-4cba-9218-9e62101051bc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.702999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3920-5623-4cba-9218-9e62101051bc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.703233 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3920-5623-4cba-9218-9e62101051bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.725495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-08eb3920-5623-4cba-9218-9e62101051bc None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:00.726733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-08eb3920-5623-4cba-9218-9e62101051bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:00.744968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1106/2179] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:00.756826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb3920-5623-4cba-9218-9e62101051bc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.772523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb3920-5623-4cba-9218-9e62101051bc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.779644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.781802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.782100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.784689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.785388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:00.787381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.796265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.796881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1074/2180] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:00 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:00.798062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.800064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:00.812132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1107/2181] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:27:00.817328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:00.832831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0f88-e2a2-4f42-a6b6-f30fa92fc9f4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.904447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:00.955972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f43f8-9533-47cc-b28c-8760fcab0eb3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:00.984603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61d24-3e60-4552-85d1-ca6a2efb90e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.984603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61d24-3e60-4552-85d1-ca6a2efb90e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.984603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61d24-3e60-4552-85d1-ca6a2efb90e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.984603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61d24-3e60-4552-85d1-ca6a2efb90e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.985047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d61d24-3e60-4552-85d1-ca6a2efb90e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.985047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d61d24-3e60-4552-85d1-ca6a2efb90e3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:00.985219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732e886-66d1-4af1-a9c9-d9626edb396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:00.985219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e886-66d1-4af1-a9c9-d9626edb396f admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:00.985219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e886-66d1-4af1-a9c9-d9626edb396f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:00.985219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732e886-66d1-4af1-a9c9-d9626edb396f admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:00.985720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732e886-66d1-4af1-a9c9-d9626edb396f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:00.987650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732e886-66d1-4af1-a9c9-d9626edb396f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.106249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1075/2182] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:00 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:01.106463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1108/2183] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:00 2022] POST /identity/v3/projects => generated 371 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:01.107141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732e886-66d1-4af1-a9c9-d9626edb396f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.109570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61d24-3e60-4552-85d1-ca6a2efb90e3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.122440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732e886-66d1-4af1-a9c9-d9626edb396f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.194547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61d24-3e60-4552-85d1-ca6a2efb90e3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.200130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5830a8-107d-48d5-bb71-0f9380edb7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.201391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5830a8-107d-48d5-bb71-0f9380edb7ce admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.202315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5830a8-107d-48d5-bb71-0f9380edb7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.202792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5830a8-107d-48d5-bb71-0f9380edb7ce admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.203690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5830a8-107d-48d5-bb71-0f9380edb7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.210639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a50ead-107b-402c-a24f-48e33b938612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.210639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a50ead-107b-402c-a24f-48e33b938612 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.210639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a50ead-107b-402c-a24f-48e33b938612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.210639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a50ead-107b-402c-a24f-48e33b938612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.211071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a50ead-107b-402c-a24f-48e33b938612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.211071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a50ead-107b-402c-a24f-48e33b938612 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.214901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5830a8-107d-48d5-bb71-0f9380edb7ce admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.224571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1076/2184] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:01.227519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a50ead-107b-402c-a24f-48e33b938612 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.241114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a50ead-107b-402c-a24f-48e33b938612 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.246902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42004e5f-ab4f-429a-8641-c22022884ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.247572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42004e5f-ab4f-429a-8641-c22022884ddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.247852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42004e5f-ab4f-429a-8641-c22022884ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.248127 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42004e5f-ab4f-429a-8641-c22022884ddb admin admin] PATH_INFO: `/v3/projects/eacbae2b670a4a0d9043b658ab940bb3/users/8b47aef7740745a3a1d1a0e9ec37fe93/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.268723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42004e5f-ab4f-429a-8641-c22022884ddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacbae2b670a4a0d9043b658ab940bb3, user_id=8b47aef7740745a3a1d1a0e9ec37fe93, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.269745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42004e5f-ab4f-429a-8641-c22022884ddb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.320716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1109/2185] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:01 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:01.324596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5830a8-107d-48d5-bb71-0f9380edb7ce admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.334270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5830a8-107d-48d5-bb71-0f9380edb7ce admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.339894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a89d0-1ec0-47c6-9c09-16634bc4d5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.340464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a89d0-1ec0-47c6-9c09-16634bc4d5fe admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.340746 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a89d0-1ec0-47c6-9c09-16634bc4d5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.341015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a89d0-1ec0-47c6-9c09-16634bc4d5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.341985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a89d0-1ec0-47c6-9c09-16634bc4d5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.343602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a89d0-1ec0-47c6-9c09-16634bc4d5fe admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.349938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1077/2186] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:01 2022] PUT /identity/v3/projects/eacbae2b670a4a0d9043b658ab940bb3/users/8b47aef7740745a3a1d1a0e9ec37fe93/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:01.365115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1110/2187] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:01.368380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42004e5f-ab4f-429a-8641-c22022884ddb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.370052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a89d0-1ec0-47c6-9c09-16634bc4d5fe admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.380215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a89d0-1ec0-47c6-9c09-16634bc4d5fe admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.454330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42004e5f-ab4f-429a-8641-c22022884ddb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.458321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a82f-0f7f-4de7-a1a3-a968b1b63f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.458940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a82f-0f7f-4de7-a1a3-a968b1b63f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.459331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a82f-0f7f-4de7-a1a3-a968b1b63f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.459495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627a82f-0f7f-4de7-a1a3-a968b1b63f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.460981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61976-9378-4ec0-a6c7-6dd160722a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.461204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627a82f-0f7f-4de7-a1a3-a968b1b63f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.461750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61976-9378-4ec0-a6c7-6dd160722a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.462173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61976-9378-4ec0-a6c7-6dd160722a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.462505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61976-9378-4ec0-a6c7-6dd160722a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.462924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627a82f-0f7f-4de7-a1a3-a968b1b63f42 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.463306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61976-9378-4ec0-a6c7-6dd160722a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.464915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61976-9378-4ec0-a6c7-6dd160722a2d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.479165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1111/2188] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:01.480741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1078/2189] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:01.480857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a82f-0f7f-4de7-a1a3-a968b1b63f42 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.483219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61976-9378-4ec0-a6c7-6dd160722a2d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.492909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627a82f-0f7f-4de7-a1a3-a968b1b63f42 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.493299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61976-9378-4ec0-a6c7-6dd160722a2d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.497580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e92871-b15f-4a51-856e-7e1126539ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.497905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c22fa5-854a-463c-a0dd-f6f24c779cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.498215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e92871-b15f-4a51-856e-7e1126539ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.498514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e92871-b15f-4a51-856e-7e1126539ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.498636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22fa5-854a-463c-a0dd-f6f24c779cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.498805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e92871-b15f-4a51-856e-7e1126539ea8 admin admin] PATH_INFO: `/v3/projects/9f7270257e0149d4b89abd73aff3fc1d/users/691e59b3d88146f5b5352eb2bb2258f1/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.498938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22fa5-854a-463c-a0dd-f6f24c779cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.499074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22fa5-854a-463c-a0dd-f6f24c779cf5 admin admin] PATH_INFO: `/v3/projects/eacbae2b670a4a0d9043b658ab940bb3/users/8b47aef7740745a3a1d1a0e9ec37fe93/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.501132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c22fa5-854a-463c-a0dd-f6f24c779cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacbae2b670a4a0d9043b658ab940bb3, user_id=8b47aef7740745a3a1d1a0e9ec37fe93, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.503792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c22fa5-854a-463c-a0dd-f6f24c779cf5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.511413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:01.515356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e92871-b15f-4a51-856e-7e1126539ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7270257e0149d4b89abd73aff3fc1d, user_id=691e59b3d88146f5b5352eb2bb2258f1, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.517576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1079/2190] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:01 2022] PUT /identity/v3/projects/eacbae2b670a4a0d9043b658ab940bb3/users/8b47aef7740745a3a1d1a0e9ec37fe93/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:01.521049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e92871-b15f-4a51-856e-7e1126539ea8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.529400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a243dd-84d0-422a-8e51-a3d4a420141e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.529692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a243dd-84d0-422a-8e51-a3d4a420141e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.538967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a243dd-84d0-422a-8e51-a3d4a420141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.559798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-22a243dd-84d0-422a-8e51-a3d4a420141e None None] MFA Rules not processed for user `8b47aef7740745a3a1d1a0e9ec37fe93`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:01.561050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-22a243dd-84d0-422a-8e51-a3d4a420141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:01.633961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1080/2191] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:01.640283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1112/2192] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:01 2022] PUT /identity/v3/projects/9f7270257e0149d4b89abd73aff3fc1d/users/691e59b3d88146f5b5352eb2bb2258f1/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:01.650058 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a243dd-84d0-422a-8e51-a3d4a420141e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.651188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d65c-fd40-479d-b172-925a96039038 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.651482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d65c-fd40-479d-b172-925a96039038 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.651588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-22a243dd-84d0-422a-8e51-a3d4a420141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:01.651765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d65c-fd40-479d-b172-925a96039038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.678731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6a51d65c-fd40-479d-b172-925a96039038 None None] MFA Rules not processed for user `691e59b3d88146f5b5352eb2bb2258f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:01.679955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a51d65c-fd40-479d-b172-925a96039038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:01.709011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a243dd-84d0-422a-8e51-a3d4a420141e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.746416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1113/2193] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:01.757458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.758095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.758372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.758695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.759220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d65c-fd40-479d-b172-925a96039038 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:01.760434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:01.760629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a51d65c-fd40-479d-b172-925a96039038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:01.818165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d65c-fd40-479d-b172-925a96039038 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:01.822406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.822680 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45d04-1cfa-46c4-85f9-b59b3068e8d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00283447a1a6405b952e541a13c91110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:01.823289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45d04-1cfa-46c4-85f9-b59b3068e8d8 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:01.823569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45d04-1cfa-46c4-85f9-b59b3068e8d8 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:01.823842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45d04-1cfa-46c4-85f9-b59b3068e8d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:01.824052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.832469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45d04-1cfa-46c4-85f9-b59b3068e8d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:01.833904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45d04-1cfa-46c4-85f9-b59b3068e8d8 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:01.834627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1081/2194] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:01.844577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1114/2195] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:01.874596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:02.268897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:02.565764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:02.749571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:03.165490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:04.129948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:04.133241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:04.214661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34912d5-887e-440c-b531-bf0982728461 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:04.220493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:04.221159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:04.221573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:04.221781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] PATH_INFO: `/v3/users/08abd391505d4aafbf0f32a286797229` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:04.222956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=08abd391505d4aafbf0f32a286797229)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:04.224965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:04.458471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08abd391505d4aafbf0f32a286797229'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:04.468866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08abd391505d4aafbf0f32a286797229'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:04.543709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08abd391505d4aafbf0f32a286797229'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:04.560410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08abd391505d4aafbf0f32a286797229'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:04.561086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08abd391505d4aafbf0f32a286797229'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:04.567294 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1082/2196] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:04 2022] DELETE /identity/v3/users/08abd391505d4aafbf0f32a286797229 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:04.572887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540762e-7360-4ee6-bb52-88891887099d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:04.573522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540762e-7360-4ee6-bb52-88891887099d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:04.573522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540762e-7360-4ee6-bb52-88891887099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:04.595694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b540762e-7360-4ee6-bb52-88891887099d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:04.597008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b540762e-7360-4ee6-bb52-88891887099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:04.658635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1115/2197] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:04.669263 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:04.670682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:04.729670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:04.733837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b342-e331-4049-97d1-281a4d0dfb5d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:04.737520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:04.738233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:04.738514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:04.738787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:04.748624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:04.750070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:04.760111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1083/2198] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:05.199038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540762e-7360-4ee6-bb52-88891887099d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:05.200723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b540762e-7360-4ee6-bb52-88891887099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:05.213272 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540762e-7360-4ee6-bb52-88891887099d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:05.218157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:05.218726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:05.219008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:05.219282 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] PATH_INFO: `/v3/users/ffd946c39b3e4cfb9792c86e0fb22e8c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:05.220462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd946c39b3e4cfb9792c86e0fb22e8c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:05.222384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:05.253332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:05.254807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:05.270716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac0d5c-ed81-4d40-b2d4-bde26fcd27f9 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:05.281024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:05.281678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:05.281958 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:05.282299 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] PATH_INFO: `/v3/projects/51627699e19d494b8ad3d0317df499cb` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:05.283384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=51627699e19d494b8ad3d0317df499cb)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:05.285421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:05.379400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:05.471031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd946c39b3e4cfb9792c86e0fb22e8c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.472007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51627699e19d494b8ad3d0317df499cb', 'request_id': 'req-376f32aa-6f93-447e-a9b2-c2c02d964a7a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.478447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd946c39b3e4cfb9792c86e0fb22e8c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.490536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd946c39b3e4cfb9792c86e0fb22e8c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.543165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51627699e19d494b8ad3d0317df499cb', 'request_id': 'req-376f32aa-6f93-447e-a9b2-c2c02d964a7a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.550461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51627699e19d494b8ad3d0317df499cb', 'request_id': 'req-376f32aa-6f93-447e-a9b2-c2c02d964a7a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.562472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] The token cache is being invalidate because project 51627699e19d494b8ad3d0317df499cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:05.562770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.563541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.565267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1084/2199] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:05 2022] DELETE /identity/v3/projects/51627699e19d494b8ad3d0317df499cb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:05.568812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:05.570369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:05.634163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd946c39b3e4cfb9792c86e0fb22e8c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.635143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cc20a3ea-7435-4750-aad0-4d1a5ea6263f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd946c39b3e4cfb9792c86e0fb22e8c'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.641253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f32aa-6f93-447e-a9b2-c2c02d964a7a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:05.646066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1116/2200] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:05 2022] DELETE /identity/v3/users/ffd946c39b3e4cfb9792c86e0fb22e8c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:05.648177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22443f-9824-4fc7-b758-70228ebb2dcd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:05.648855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22443f-9824-4fc7-b758-70228ebb2dcd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:05.649218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22443f-9824-4fc7-b758-70228ebb2dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:05.669999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4b22443f-9824-4fc7-b758-70228ebb2dcd None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:05.674446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4b22443f-9824-4fc7-b758-70228ebb2dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:05.726087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:05.727423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:05.727919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:05.728046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] PATH_INFO: `/v3/users/b6f3aaee7d124d28b2549515671eecd7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:05.729216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f3aaee7d124d28b2549515671eecd7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:05.731173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:05.741611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1117/2201] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:05.751753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22443f-9824-4fc7-b758-70228ebb2dcd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:05.753218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4b22443f-9824-4fc7-b758-70228ebb2dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:05.761552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:05.811114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22443f-9824-4fc7-b758-70228ebb2dcd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:05.814777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:05.815436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:05.815718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:05.815984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:05.825222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:05.826750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:05.843884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1118/2202] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:05.943533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f3aaee7d124d28b2549515671eecd7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:05.949388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f3aaee7d124d28b2549515671eecd7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.041836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f3aaee7d124d28b2549515671eecd7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.069009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f3aaee7d124d28b2549515671eecd7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.070128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f3aaee7d124d28b2549515671eecd7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.076690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1085/2203] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:05 2022] DELETE /identity/v3/users/b6f3aaee7d124d28b2549515671eecd7 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:06.430489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:06.432220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:06.455815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1eef-11e6-484f-af26-408461de4d5c service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:06.511491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:06.528118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:06.528790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:06.529070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:06.529341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] PATH_INFO: `/v3/projects/9be1b87fc90c4a74bcb47eb9f4bbe799` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:06.530502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be1b87fc90c4a74bcb47eb9f4bbe799)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:06.532452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:06.699465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be1b87fc90c4a74bcb47eb9f4bbe799', 'request_id': 'req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.706038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be1b87fc90c4a74bcb47eb9f4bbe799', 'request_id': 'req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.711906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be1b87fc90c4a74bcb47eb9f4bbe799', 'request_id': 'req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.723674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:06.728067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:06.745538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb3f32-6b9f-48f1-bb39-ce78505aaddc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:06.816539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:06.817178 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:06.817462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:06.817886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] PATH_INFO: `/v3/projects/b5b91441de9949f48d47ec84139b59b2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:06.819093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b91441de9949f48d47ec84139b59b2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:06.821873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:06.836069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] The token cache is being invalidate because project 9be1b87fc90c4a74bcb47eb9f4bbe799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:06.837809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.838110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:06.839724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1119/2204] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:06 2022] DELETE /identity/v3/projects/9be1b87fc90c4a74bcb47eb9f4bbe799 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:06.844332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:06.845817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:06.863572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e1e1f-fd4e-4dd1-b279-a9e48a4752eb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:06.868934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:06.869570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:06.869851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:06.870125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] PATH_INFO: `/v3/users/8b47aef7740745a3a1d1a0e9ec37fe93` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:06.871295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b47aef7740745a3a1d1a0e9ec37fe93)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:06.873270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:06.973659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b91441de9949f48d47ec84139b59b2', 'request_id': 'req-1f061e92-80a0-43ed-9a10-efefcdbb2b80'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.085754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b91441de9949f48d47ec84139b59b2', 'request_id': 'req-1f061e92-80a0-43ed-9a10-efefcdbb2b80'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.093182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b91441de9949f48d47ec84139b59b2', 'request_id': 'req-1f061e92-80a0-43ed-9a10-efefcdbb2b80'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.104240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] The token cache is being invalidate because project b5b91441de9949f48d47ec84139b59b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:07.104558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.105235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1f061e92-80a0-43ed-9a10-efefcdbb2b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.106750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1086/2205] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:06 2022] DELETE /identity/v3/projects/b5b91441de9949f48d47ec84139b59b2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:07.111855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d356c4-66b5-4375-9a56-c74ffd16c9f8 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.112138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d356c4-66b5-4375-9a56-c74ffd16c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.112455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d356c4-66b5-4375-9a56-c74ffd16c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.141502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f9d356c4-66b5-4375-9a56-c74ffd16c9f8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:07.142900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f9d356c4-66b5-4375-9a56-c74ffd16c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:07.151828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b47aef7740745a3a1d1a0e9ec37fe93'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.163026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b47aef7740745a3a1d1a0e9ec37fe93'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.177272 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b47aef7740745a3a1d1a0e9ec37fe93'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.192045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:07.239084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1087/2206] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:07.242954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d11e81-0b09-4bef-8f16-87d6745f8b6e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.242954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d11e81-0b09-4bef-8f16-87d6745f8b6e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.242954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d11e81-0b09-4bef-8f16-87d6745f8b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.261528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-03d11e81-0b09-4bef-8f16-87d6745f8b6e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:07.262997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-03d11e81-0b09-4bef-8f16-87d6745f8b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:07.271820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b47aef7740745a3a1d1a0e9ec37fe93'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.271820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b47aef7740745a3a1d1a0e9ec37fe93'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.272265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1088/2207] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:07.276672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d11e81-0b09-4bef-8f16-87d6745f8b6e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:07.286273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1120/2208] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:06 2022] DELETE /identity/v3/users/8b47aef7740745a3a1d1a0e9ec37fe93 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:07.294643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d11e81-0b09-4bef-8f16-87d6745f8b6e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:07.349903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:07.350441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.350875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.351181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.352836 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:07.353277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:07.355099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:07.370683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1089/2209] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:27:07.372074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:07.373828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:07.388534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5b60-6123-44f2-8bcd-03e74ab0403e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:07.393525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:07.394143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.394426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.394702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.395351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:07.397303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:07.532042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1121/2210] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:07 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:07.533145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:07.545201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e6984-17f0-489d-9333-5436b427785a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:07.616771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6075c29-7956-4a7d-b0f4-eb619039aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:07.618141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6075c29-7956-4a7d-b0f4-eb619039aeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.618636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6075c29-7956-4a7d-b0f4-eb619039aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.618954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6075c29-7956-4a7d-b0f4-eb619039aeb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.619599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6075c29-7956-4a7d-b0f4-eb619039aeb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:07.622057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6075c29-7956-4a7d-b0f4-eb619039aeb2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:07.737760 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1090/2211] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:07 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:07.741753 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6075c29-7956-4a7d-b0f4-eb619039aeb2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:07.741905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:07.744212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:07.764967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6075c29-7956-4a7d-b0f4-eb619039aeb2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:07.770244 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428909b-f5d7-4df1-8584-07855fd6719d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:07.770374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc775c-21a7-4414-a977-e375febf14ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:07.770879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc775c-21a7-4414-a977-e375febf14ee admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.771161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc775c-21a7-4414-a977-e375febf14ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.771694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc775c-21a7-4414-a977-e375febf14ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.772085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc775c-21a7-4414-a977-e375febf14ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:07.773876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc775c-21a7-4414-a977-e375febf14ee admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:07.785739 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1091/2212] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:07.785910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:07.787066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.787364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.787646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] PATH_INFO: `/v3/projects/eacbae2b670a4a0d9043b658ab940bb3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.790270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc775c-21a7-4414-a977-e375febf14ee admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:07.790439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eacbae2b670a4a0d9043b658ab940bb3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:07.792593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:07.806168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc775c-21a7-4414-a977-e375febf14ee admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:07.811475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8cf95-aa5f-41cc-ba4f-443279615a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:07.812242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cf95-aa5f-41cc-ba4f-443279615a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.813174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cf95-aa5f-41cc-ba4f-443279615a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.813174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8cf95-aa5f-41cc-ba4f-443279615a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.813713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8cf95-aa5f-41cc-ba4f-443279615a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:07.815528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8cf95-aa5f-41cc-ba4f-443279615a9c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:07.828154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=79,keystone:DELETE=18,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:07.842251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1092/2213] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:07.846224 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8cf95-aa5f-41cc-ba4f-443279615a9c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:07.856945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8cf95-aa5f-41cc-ba4f-443279615a9c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:07.861912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b582627-6c94-4823-b5e5-651f3e823f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:07.862562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b582627-6c94-4823-b5e5-651f3e823f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.862840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b582627-6c94-4823-b5e5-651f3e823f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.863113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b582627-6c94-4823-b5e5-651f3e823f43 admin admin] PATH_INFO: `/v3/projects/0a3bca3fa4154baebe77356423dfb158/users/fd0679e8970c46f7a1c359fc7385c811/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.879523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b582627-6c94-4823-b5e5-651f3e823f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a3bca3fa4154baebe77356423dfb158, user_id=fd0679e8970c46f7a1c359fc7385c811, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:07.883137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b582627-6c94-4823-b5e5-651f3e823f43 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:07.972621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1093/2214] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:07 2022] PUT /identity/v3/projects/0a3bca3fa4154baebe77356423dfb158/users/fd0679e8970c46f7a1c359fc7385c811/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:07.979050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eacbae2b670a4a0d9043b658ab940bb3', 'request_id': 'req-cbaca3e6-1566-467b-91ee-b622f7c14f00'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.984949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239459-18b3-4e92-8e7e-3f121150ff5d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:07.985476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239459-18b3-4e92-8e7e-3f121150ff5d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:07.986069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99239459-18b3-4e92-8e7e-3f121150ff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:07.990046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eacbae2b670a4a0d9043b658ab940bb3', 'request_id': 'req-cbaca3e6-1566-467b-91ee-b622f7c14f00'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:07.997327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eacbae2b670a4a0d9043b658ab940bb3', 'request_id': 'req-cbaca3e6-1566-467b-91ee-b622f7c14f00'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:08.016205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-99239459-18b3-4e92-8e7e-3f121150ff5d None None] MFA Rules not processed for user `fd0679e8970c46f7a1c359fc7385c811`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:08.017457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-99239459-18b3-4e92-8e7e-3f121150ff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:08.087229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1094/2215] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:08.091747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239459-18b3-4e92-8e7e-3f121150ff5d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.097960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] The token cache is being invalidate because project eacbae2b670a4a0d9043b658ab940bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:08.098457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:08.101174 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbaca3e6-1566-467b-91ee-b622f7c14f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:08.102972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1122/2216] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:07 2022] DELETE /identity/v3/projects/eacbae2b670a4a0d9043b658ab940bb3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:08.114230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831445d3-a6d2-4fe7-b855-8d39ed962a61 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.114499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831445d3-a6d2-4fe7-b855-8d39ed962a61 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.114781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831445d3-a6d2-4fe7-b855-8d39ed962a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.134559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-831445d3-a6d2-4fe7-b855-8d39ed962a61 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:08.136094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-831445d3-a6d2-4fe7-b855-8d39ed962a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:08.150181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:08.160945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99239459-18b3-4e92-8e7e-3f121150ff5d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.166334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.166944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.167229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.167505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.168148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.170181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.196122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1123/2217] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:08.204388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22dd83-35f6-4bd2-8837-40910654f2e7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.204919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22dd83-35f6-4bd2-8837-40910654f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.205385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22dd83-35f6-4bd2-8837-40910654f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.225098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1f22dd83-35f6-4bd2-8837-40910654f2e7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:08.226370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1f22dd83-35f6-4bd2-8837-40910654f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:08.235634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1124/2218] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:08.240605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22dd83-35f6-4bd2-8837-40910654f2e7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.250696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22dd83-35f6-4bd2-8837-40910654f2e7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.255488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.256240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.256511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.256852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.257513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:08.257826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.259415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.274124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1125/2219] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:27:08.281842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1095/2220] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:08 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:08.283642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.283807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.285567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:08.294331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f2b8-4c7e-45d3-b66a-075308b91fd1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.353892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c706f0-c337-419c-91cc-0bb0438863c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.354526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c706f0-c337-419c-91cc-0bb0438863c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.354810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c706f0-c337-419c-91cc-0bb0438863c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.355092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c706f0-c337-419c-91cc-0bb0438863c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.355202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab05476-5300-4dc1-b1b0-b4a480496770 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.355740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c706f0-c337-419c-91cc-0bb0438863c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.357737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c706f0-c337-419c-91cc-0bb0438863c2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.362701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d437f-3822-4048-bea3-f593e4fe0d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.366088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d437f-3822-4048-bea3-f593e4fe0d28 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.366088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d437f-3822-4048-bea3-f593e4fe0d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.366088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d437f-3822-4048-bea3-f593e4fe0d28 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.366088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d437f-3822-4048-bea3-f593e4fe0d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.367396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d437f-3822-4048-bea3-f593e4fe0d28 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.465875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1096/2221] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:08 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:08.466076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1126/2222] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:08 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:08.467407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d437f-3822-4048-bea3-f593e4fe0d28 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.468108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c706f0-c337-419c-91cc-0bb0438863c2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.479117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d437f-3822-4048-bea3-f593e4fe0d28 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.536949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c706f0-c337-419c-91cc-0bb0438863c2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.540484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883da49-fb4e-481d-9220-b255225adbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.541306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883da49-fb4e-481d-9220-b255225adbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.541791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883da49-fb4e-481d-9220-b255225adbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.542216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883da49-fb4e-481d-9220-b255225adbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.542504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceb494-7b87-46cc-9d3a-9d19c46c6d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.543112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceb494-7b87-46cc-9d3a-9d19c46c6d71 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.543398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceb494-7b87-46cc-9d3a-9d19c46c6d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.543511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883da49-fb4e-481d-9220-b255225adbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.543792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceb494-7b87-46cc-9d3a-9d19c46c6d71 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.544492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceb494-7b87-46cc-9d3a-9d19c46c6d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.545612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883da49-fb4e-481d-9220-b255225adbe2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.546409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceb494-7b87-46cc-9d3a-9d19c46c6d71 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.560489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1097/2223] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:08.561563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883da49-fb4e-481d-9220-b255225adbe2 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.571727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883da49-fb4e-481d-9220-b255225adbe2 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.581474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf52c4-9c34-4b70-98ad-2b4abd09359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.581474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf52c4-9c34-4b70-98ad-2b4abd09359f admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.581474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf52c4-9c34-4b70-98ad-2b4abd09359f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.581474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf52c4-9c34-4b70-98ad-2b4abd09359f admin admin] PATH_INFO: `/v3/projects/b9d06118effe4f54800e60cca390092c/users/95abdb6e29fc4d17ba778642d0fdead2/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.594460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf52c4-9c34-4b70-98ad-2b4abd09359f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d06118effe4f54800e60cca390092c, user_id=95abdb6e29fc4d17ba778642d0fdead2, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.597295 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf52c4-9c34-4b70-98ad-2b4abd09359f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.674874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1127/2224] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:08 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:08.679044 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceb494-7b87-46cc-9d3a-9d19c46c6d71 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.689918 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceb494-7b87-46cc-9d3a-9d19c46c6d71 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.694506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4e86-3bbf-4fae-963a-4b08de813597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.695966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4e86-3bbf-4fae-963a-4b08de813597 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.695966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4e86-3bbf-4fae-963a-4b08de813597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.695966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4e86-3bbf-4fae-963a-4b08de813597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.696665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4e86-3bbf-4fae-963a-4b08de813597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.698283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4e86-3bbf-4fae-963a-4b08de813597 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.708581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1128/2225] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:08.713178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4e86-3bbf-4fae-963a-4b08de813597 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.716652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1098/2226] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:08 2022] PUT /identity/v3/projects/b9d06118effe4f54800e60cca390092c/users/95abdb6e29fc4d17ba778642d0fdead2/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:08.720320 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf52c4-9c34-4b70-98ad-2b4abd09359f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.722895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4e86-3bbf-4fae-963a-4b08de813597 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.793271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf52c4-9c34-4b70-98ad-2b4abd09359f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.796734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f72643-215b-4236-977d-2bf98f1f78dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.797456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f72643-215b-4236-977d-2bf98f1f78dc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.797815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f72643-215b-4236-977d-2bf98f1f78dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.798202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f72643-215b-4236-977d-2bf98f1f78dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.798338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef34b9-14a2-4466-bf6e-7538c6595ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.799024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef34b9-14a2-4466-bf6e-7538c6595ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.799180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f72643-215b-4236-977d-2bf98f1f78dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.799419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef34b9-14a2-4466-bf6e-7538c6595ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.799717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef34b9-14a2-4466-bf6e-7538c6595ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.800524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef34b9-14a2-4466-bf6e-7538c6595ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.801123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f72643-215b-4236-977d-2bf98f1f78dc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.805135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef34b9-14a2-4466-bf6e-7538c6595ea8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.816049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1129/2227] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:08.816238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1099/2228] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:08.817165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f72643-215b-4236-977d-2bf98f1f78dc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.821429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef34b9-14a2-4466-bf6e-7538c6595ea8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:08.830059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f72643-215b-4236-977d-2bf98f1f78dc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.841835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c7f47-552e-4b92-a0d4-afac2cbea455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.842309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef34b9-14a2-4466-bf6e-7538c6595ea8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:08.843678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7f47-552e-4b92-a0d4-afac2cbea455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.846103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7f47-552e-4b92-a0d4-afac2cbea455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.846103 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c7f47-552e-4b92-a0d4-afac2cbea455 admin admin] PATH_INFO: `/v3/projects/9ede25ddd70d44398c48d76799a162ee/users/d199c056df4348b8970a6880c79a6966/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.851351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:08.861370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb98daa-6827-42e5-8b31-ad44c3d4f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:08.862069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98daa-6827-42e5-8b31-ad44c3d4f799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.862621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98daa-6827-42e5-8b31-ad44c3d4f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.862906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb98daa-6827-42e5-8b31-ad44c3d4f799 admin admin] PATH_INFO: `/v3/projects/b9d06118effe4f54800e60cca390092c/users/95abdb6e29fc4d17ba778642d0fdead2/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.864878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb98daa-6827-42e5-8b31-ad44c3d4f799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d06118effe4f54800e60cca390092c, user_id=95abdb6e29fc4d17ba778642d0fdead2, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.867829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb98daa-6827-42e5-8b31-ad44c3d4f799 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.875600 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7f47-552e-4b92-a0d4-afac2cbea455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ede25ddd70d44398c48d76799a162ee, user_id=d199c056df4348b8970a6880c79a6966, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:08.879513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c7f47-552e-4b92-a0d4-afac2cbea455 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:08.881043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1100/2229] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:08 2022] PUT /identity/v3/projects/b9d06118effe4f54800e60cca390092c/users/95abdb6e29fc4d17ba778642d0fdead2/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:08.895453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846fcf9-ada6-473c-8b73-68a6be3cd242 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.895720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846fcf9-ada6-473c-8b73-68a6be3cd242 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.895987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846fcf9-ada6-473c-8b73-68a6be3cd242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:08.931641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8846fcf9-ada6-473c-8b73-68a6be3cd242 None None] MFA Rules not processed for user `95abdb6e29fc4d17ba778642d0fdead2`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:08.936535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8846fcf9-ada6-473c-8b73-68a6be3cd242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:08.937974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:08.971809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1130/2230] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:08 2022] PUT /identity/v3/projects/9ede25ddd70d44398c48d76799a162ee/users/d199c056df4348b8970a6880c79a6966/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:08.982938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0507-7ad0-4326-9339-317731b6d3e2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:08.983332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0507-7ad0-4326-9339-317731b6d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:08.983674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0507-7ad0-4326-9339-317731b6d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.011079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-31fc0507-7ad0-4326-9339-317731b6d3e2 None None] MFA Rules not processed for user `d199c056df4348b8970a6880c79a6966`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:09.012604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-31fc0507-7ad0-4326-9339-317731b6d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:09.017737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1101/2231] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:09.030041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846fcf9-ada6-473c-8b73-68a6be3cd242 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:09.031422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8846fcf9-ada6-473c-8b73-68a6be3cd242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:09.080198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1131/2232] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:09.085056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc0507-7ad0-4326-9339-317731b6d3e2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:09.090967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846fcf9-ada6-473c-8b73-68a6be3cd242 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:09.147339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9b1f8-34e6-487c-acc8-f49bf6e53a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:09.147950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b1f8-34e6-487c-acc8-f49bf6e53a79 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:09.149161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b1f8-34e6-487c-acc8-f49bf6e53a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:09.149425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9b1f8-34e6-487c-acc8-f49bf6e53a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.156684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc0507-7ad0-4326-9339-317731b6d3e2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:09.163173 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be735332-b6d4-4881-872b-ffa78aed7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:09.164414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735332-b6d4-4881-872b-ffa78aed7a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:09.164414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735332-b6d4-4881-872b-ffa78aed7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:09.164624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735332-b6d4-4881-872b-ffa78aed7a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.165402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be735332-b6d4-4881-872b-ffa78aed7a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:09.167331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be735332-b6d4-4881-872b-ffa78aed7a5c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:09.184855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:09.222297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9b1f8-34e6-487c-acc8-f49bf6e53a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:09.223864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9b1f8-34e6-487c-acc8-f49bf6e53a79 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:09.235762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1102/2233] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:27:09.274295 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9b1f8-34e6-487c-acc8-f49bf6e53a79 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:09.275538 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1132/2234] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:09 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:09.279303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be735332-b6d4-4881-872b-ffa78aed7a5c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:09.286401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9b1f8-34e6-487c-acc8-f49bf6e53a79 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:09.390356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be735332-b6d4-4881-872b-ffa78aed7a5c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:09.395277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36958d-cc11-4a9c-80d4-5ed6b14fa321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:09.395906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36958d-cc11-4a9c-80d4-5ed6b14fa321 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:09.396186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36958d-cc11-4a9c-80d4-5ed6b14fa321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:09.396518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36958d-cc11-4a9c-80d4-5ed6b14fa321 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.397184 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36958d-cc11-4a9c-80d4-5ed6b14fa321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:09.400264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36958d-cc11-4a9c-80d4-5ed6b14fa321 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:09.452250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:09.510461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1133/2235] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:09 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:09.514613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36958d-cc11-4a9c-80d4-5ed6b14fa321 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:09.516730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:09.517398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:09.517672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:09.517941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] PATH_INFO: `/v3/users/fd0679e8970c46f7a1c359fc7385c811` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.519241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0679e8970c46f7a1c359fc7385c811)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:09.521470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:09.525759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36958d-cc11-4a9c-80d4-5ed6b14fa321 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:09.530841 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3804f-74aa-4456-97c2-85cf42199b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:09.531571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3804f-74aa-4456-97c2-85cf42199b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:09.531855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3804f-74aa-4456-97c2-85cf42199b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:09.532176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3804f-74aa-4456-97c2-85cf42199b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.533042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3804f-74aa-4456-97c2-85cf42199b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:09.534690 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3804f-74aa-4456-97c2-85cf42199b4a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:09.550086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1134/2236] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:09.551187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3804f-74aa-4456-97c2-85cf42199b4a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:09.561703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3804f-74aa-4456-97c2-85cf42199b4a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:09.566378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed569b-30b8-4c06-962f-7e56a428ec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:09.567048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed569b-30b8-4c06-962f-7e56a428ec5e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:09.567386 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed569b-30b8-4c06-962f-7e56a428ec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:09.567683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed569b-30b8-4c06-962f-7e56a428ec5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.568431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed569b-30b8-4c06-962f-7e56a428ec5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:09.570789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed569b-30b8-4c06-962f-7e56a428ec5e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:09.581906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1135/2237] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:09.586036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed569b-30b8-4c06-962f-7e56a428ec5e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:09.595700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed569b-30b8-4c06-962f-7e56a428ec5e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:09.603209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f8bd4-f854-4a01-8d6b-014e2e5f7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:09.605285 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8bd4-f854-4a01-8d6b-014e2e5f7933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:09.605874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8bd4-f854-4a01-8d6b-014e2e5f7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:09.606232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8bd4-f854-4a01-8d6b-014e2e5f7933 admin admin] PATH_INFO: `/v3/projects/043df9f57adf4afe916a9570dde8c6c5/users/54e63fce441948b4ac9c84fee5e39398/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.622403 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f8bd4-f854-4a01-8d6b-014e2e5f7933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043df9f57adf4afe916a9570dde8c6c5, user_id=54e63fce441948b4ac9c84fee5e39398, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:09.625105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f8bd4-f854-4a01-8d6b-014e2e5f7933 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:09.771544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:09.777489 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1136/2238] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:09 2022] PUT /identity/v3/projects/043df9f57adf4afe916a9570dde8c6c5/users/54e63fce441948b4ac9c84fee5e39398/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:09.847018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f857-4ecc-4675-8bf3-2af851ee7df4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:09.847685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f857-4ecc-4675-8bf3-2af851ee7df4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:09.847685 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864f857-4ecc-4675-8bf3-2af851ee7df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:09.852748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0679e8970c46f7a1c359fc7385c811'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:09.860053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0679e8970c46f7a1c359fc7385c811'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:09.878417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2864f857-4ecc-4675-8bf3-2af851ee7df4 None None] MFA Rules not processed for user `54e63fce441948b4ac9c84fee5e39398`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:09.879653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2864f857-4ecc-4675-8bf3-2af851ee7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:09.950926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:09.957911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1137/2239] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:09.959824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864f857-4ecc-4675-8bf3-2af851ee7df4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:09.961348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2864f857-4ecc-4675-8bf3-2af851ee7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:10.008829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0679e8970c46f7a1c359fc7385c811'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:10.022539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0679e8970c46f7a1c359fc7385c811'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:10.023440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0679e8970c46f7a1c359fc7385c811'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:10.029726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1103/2240] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:09 2022] DELETE /identity/v3/users/fd0679e8970c46f7a1c359fc7385c811 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:10.030617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:10.032134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:10.032923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864f857-4ecc-4675-8bf3-2af851ee7df4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:10.096234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:10.096895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.097175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.097447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] PATH_INFO: `/v3/users/81ed9e4288a148d59632759d1c9fd706` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.098688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ed9e4288a148d59632759d1c9fd706)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:10.100768 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:10.129330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483197c9-dcbc-4499-8ab3-45883215a4b6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:10.136359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063cd8-71f9-4bec-b480-44e7bb60937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:10.139886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063cd8-71f9-4bec-b480-44e7bb60937c admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.139886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063cd8-71f9-4bec-b480-44e7bb60937c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.139886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063cd8-71f9-4bec-b480-44e7bb60937c admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.139886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063cd8-71f9-4bec-b480-44e7bb60937c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:10.140493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063cd8-71f9-4bec-b480-44e7bb60937c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:10.255345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1104/2241] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:10 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:10.255345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a92ba-2086-402e-9d9a-da9f305c4873 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.255345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a92ba-2086-402e-9d9a-da9f305c4873 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.255690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a92ba-2086-402e-9d9a-da9f305c4873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.275422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-531a92ba-2086-402e-9d9a-da9f305c4873 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:10.276662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-531a92ba-2086-402e-9d9a-da9f305c4873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:10.331487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:10.344996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1105/2242] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:10.346097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a92ba-2086-402e-9d9a-da9f305c4873 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:10.360451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ed9e4288a148d59632759d1c9fd706'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:10.369282 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ed9e4288a148d59632759d1c9fd706'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:10.370661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a92ba-2086-402e-9d9a-da9f305c4873 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:10.381892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fb9df-0f19-456d-a172-71f68d42eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:10.382490 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:10.382994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb9df-0f19-456d-a172-71f68d42eb55 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.382994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb9df-0f19-456d-a172-71f68d42eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.383365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb9df-0f19-456d-a172-71f68d42eb55 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.384236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fb9df-0f19-456d-a172-71f68d42eb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:10.387476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fb9df-0f19-456d-a172-71f68d42eb55 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:10.392213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ed9e4288a148d59632759d1c9fd706'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:10.485820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ed9e4288a148d59632759d1c9fd706'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:10.486544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ed9e4288a148d59632759d1c9fd706'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:10.494603 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1138/2243] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:09 2022] DELETE /identity/v3/users/81ed9e4288a148d59632759d1c9fd706 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:10.495889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:10.500637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:10.525964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1106/2244] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:10 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:10.525964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa0382-2f09-4e0f-bba0-4b1c06637ace None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.525964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa0382-2f09-4e0f-bba0-4b1c06637ace None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.525964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa0382-2f09-4e0f-bba0-4b1c06637ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.553734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-12fa0382-2f09-4e0f-bba0-4b1c06637ace None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:10.555119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-12fa0382-2f09-4e0f-bba0-4b1c06637ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:10.573993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740b0bf-697e-488e-b408-3eb0325b9d49 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:10.578031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:10.578657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.578988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.579268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.581398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:10.621765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1107/2245] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:10.622713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa0382-2f09-4e0f-bba0-4b1c06637ace None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:10.623986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-12fa0382-2f09-4e0f-bba0-4b1c06637ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:10.636565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa0382-2f09-4e0f-bba0-4b1c06637ace None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:10.642244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c38e-1e03-4b03-b88c-b19e28509531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:10.642974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c38e-1e03-4b03-b88c-b19e28509531 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.643321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c38e-1e03-4b03-b88c-b19e28509531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.643623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3c38e-1e03-4b03-b88c-b19e28509531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.644280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3c38e-1e03-4b03-b88c-b19e28509531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:10.645964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3c38e-1e03-4b03-b88c-b19e28509531 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:10.657372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:10.657715 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1108/2246] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:10.658546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c38e-1e03-4b03-b88c-b19e28509531 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:10.658923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:10.668486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3c38e-1e03-4b03-b88c-b19e28509531 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:10.669758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1139/2247] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:10.670573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:10.674601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344caf55-ce72-4533-af68-40859c72b356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:10.678111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344caf55-ce72-4533-af68-40859c72b356 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.678111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344caf55-ce72-4533-af68-40859c72b356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.678111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344caf55-ce72-4533-af68-40859c72b356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.681806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf370-b94b-4be6-8e70-066859d44544 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:10.686682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375eaa-7923-42bd-b2d0-471d1637be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:10.687346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375eaa-7923-42bd-b2d0-471d1637be06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:10.687488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344caf55-ce72-4533-af68-40859c72b356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:10.687658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375eaa-7923-42bd-b2d0-471d1637be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:10.687906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9375eaa-7923-42bd-b2d0-471d1637be06 admin admin] PATH_INFO: `/v3/projects/dfc44248a75e4d579d8aa36d092ad735/users/d00b5de4cc6449368ec4aee6614baa1e/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:10.688931 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344caf55-ce72-4533-af68-40859c72b356 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:10.704638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1109/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:10.859135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9375eaa-7923-42bd-b2d0-471d1637be06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc44248a75e4d579d8aa36d092ad735, user_id=d00b5de4cc6449368ec4aee6614baa1e, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:10.865702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9375eaa-7923-42bd-b2d0-471d1637be06 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:10.952665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1140/2249] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:10 2022] PUT /identity/v3/projects/dfc44248a75e4d579d8aa36d092ad735/users/d00b5de4cc6449368ec4aee6614baa1e/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:10.954156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344caf55-ce72-4533-af68-40859c72b356 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:10.965151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344caf55-ce72-4533-af68-40859c72b356 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:11.053387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fad99-8912-4774-9beb-418ad6d0c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:11.054007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fad99-8912-4774-9beb-418ad6d0c884 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.054286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fad99-8912-4774-9beb-418ad6d0c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.055081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fad99-8912-4774-9beb-418ad6d0c884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.055739 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fad99-8912-4774-9beb-418ad6d0c884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:11.057541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fad99-8912-4774-9beb-418ad6d0c884 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:11.067999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1110/2250] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:11.073124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375eaa-7923-42bd-b2d0-471d1637be06 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:11.086708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9375eaa-7923-42bd-b2d0-471d1637be06 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:11.093850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:11.094927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.095210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.095498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] PATH_INFO: `/v3/projects/dfc44248a75e4d579d8aa36d092ad735/users/d00b5de4cc6449368ec4aee6614baa1e/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.098465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc44248a75e4d579d8aa36d092ad735, user_id=d00b5de4cc6449368ec4aee6614baa1e, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:11.101791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:11.121449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1141/2251] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:11 2022] PUT /identity/v3/projects/dfc44248a75e4d579d8aa36d092ad735/users/d00b5de4cc6449368ec4aee6614baa1e/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:11.125811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b9f2-a6b7-4305-bdb1-3baa918d91dc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.126103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b9f2-a6b7-4305-bdb1-3baa918d91dc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.126410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175b9f2-a6b7-4305-bdb1-3baa918d91dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.160618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3175b9f2-a6b7-4305-bdb1-3baa918d91dc None None] MFA Rules not processed for user `d00b5de4cc6449368ec4aee6614baa1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:11.161838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3175b9f2-a6b7-4305-bdb1-3baa918d91dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:11.219279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:11.259569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1111/2252] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:11.274410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:11.278006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:11.323265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175b9f2-a6b7-4305-bdb1-3baa918d91dc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:11.330481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3175b9f2-a6b7-4305-bdb1-3baa918d91dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:11.345454 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57932313-9b2e-47c9-9b70-52ba89572d59 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:11.350086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:11.350914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.351843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.352181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.354231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:11.365402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:11.427644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175b9f2-a6b7-4305-bdb1-3baa918d91dc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:11.433524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:11.435139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.435429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.435690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] PATH_INFO: `/v3/projects/0a3bca3fa4154baebe77356423dfb158` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.436874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:11.437372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a3bca3fa4154baebe77356423dfb158)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:11.441076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:11.441545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:11.449849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1142/2253] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:11.456679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:11.456679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:11.469054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac2ed4-3bcd-4eb7-97b9-8432be294544 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:11.474120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:11.474754 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.475037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.475315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] PATH_INFO: `/v3/projects/bf1439f159904209bedb1fd3daad6bd7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.480193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1439f159904209bedb1fd3daad6bd7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:11.485093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:11.582313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a3bca3fa4154baebe77356423dfb158', 'request_id': 'req-d55c0efd-56a7-4897-8790-f6d05e868bce'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.613200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1439f159904209bedb1fd3daad6bd7', 'request_id': 'req-52124f4c-860e-43ac-bc6c-379dd82983ab'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.620363 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1439f159904209bedb1fd3daad6bd7', 'request_id': 'req-52124f4c-860e-43ac-bc6c-379dd82983ab'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.626475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1439f159904209bedb1fd3daad6bd7', 'request_id': 'req-52124f4c-860e-43ac-bc6c-379dd82983ab'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.679025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a3bca3fa4154baebe77356423dfb158', 'request_id': 'req-d55c0efd-56a7-4897-8790-f6d05e868bce'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.687580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a3bca3fa4154baebe77356423dfb158', 'request_id': 'req-d55c0efd-56a7-4897-8790-f6d05e868bce'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.703328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] The token cache is being invalidate because project 0a3bca3fa4154baebe77356423dfb158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:11.703724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.707372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.709398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1112/2254] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:11 2022] DELETE /identity/v3/projects/0a3bca3fa4154baebe77356423dfb158 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:11.717297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:11.721045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:11.760392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] The token cache is being invalidate because project bf1439f159904209bedb1fd3daad6bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:11.760753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.761775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-52124f4c-860e-43ac-bc6c-379dd82983ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:11.763904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1143/2255] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:11 2022] DELETE /identity/v3/projects/bf1439f159904209bedb1fd3daad6bd7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:11.768703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02c35-680e-4eb6-8ea0-54c9b3951cab None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.768989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02c35-680e-4eb6-8ea0-54c9b3951cab None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.769264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02c35-680e-4eb6-8ea0-54c9b3951cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.791966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c9f02c35-680e-4eb6-8ea0-54c9b3951cab None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:11.793372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c9f02c35-680e-4eb6-8ea0-54c9b3951cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:11.810604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c0efd-56a7-4897-8790-f6d05e868bce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:11.823627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:11.864521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1144/2256] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:11.866297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5f40-6d08-4cae-acda-2fa2696cfeee None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.866546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5f40-6d08-4cae-acda-2fa2696cfeee None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.868090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5f40-6d08-4cae-acda-2fa2696cfeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.895384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:11.896660 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.897004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.897827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] PATH_INFO: `/v3/users/95abdb6e29fc4d17ba778642d0fdead2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.899084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] RBAC: Authorizing `identity:delete_user(user_id=95abdb6e29fc4d17ba778642d0fdead2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:11.902765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:11.926412 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-660e5f40-6d08-4cae-acda-2fa2696cfeee None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:11.928111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-660e5f40-6d08-4cae-acda-2fa2696cfeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:11.944653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1145/2257] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:11.951110 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e5f40-6d08-4cae-acda-2fa2696cfeee None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:11.961880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e5f40-6d08-4cae-acda-2fa2696cfeee None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:11.966723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:11.967343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:11.971221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:11.971221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:11.971221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:11.971221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:11.971221 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:11.986920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1146/2258] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:27:11.991226 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:12.002908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5a37e-0a39-4dac-90c9-1e51b94686bc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:12.009067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4339-126c-4da0-803f-9567ab97f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:12.010080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4339-126c-4da0-803f-9567ab97f53d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:12.010369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4339-126c-4da0-803f-9567ab97f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:12.011418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4339-126c-4da0-803f-9567ab97f53d admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:12.012428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e4339-126c-4da0-803f-9567ab97f53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:12.014497 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e4339-126c-4da0-803f-9567ab97f53d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:12.112898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1147/2259] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:11 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:12.117801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4339-126c-4da0-803f-9567ab97f53d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:12.173630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95abdb6e29fc4d17ba778642d0fdead2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:12.183921 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95abdb6e29fc4d17ba778642d0fdead2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:12.222276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:12.227295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4339-126c-4da0-803f-9567ab97f53d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:12.232540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03165d2c-fe61-46ae-9041-731f0db77523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:12.233118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03165d2c-fe61-46ae-9041-731f0db77523 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:12.233402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03165d2c-fe61-46ae-9041-731f0db77523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:12.233704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03165d2c-fe61-46ae-9041-731f0db77523 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:12.234357 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03165d2c-fe61-46ae-9041-731f0db77523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:12.236385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03165d2c-fe61-46ae-9041-731f0db77523 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:12.245373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95abdb6e29fc4d17ba778642d0fdead2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:12.264124 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95abdb6e29fc4d17ba778642d0fdead2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:12.264971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95abdb6e29fc4d17ba778642d0fdead2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:12.272216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1113/2260] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:11 2022] DELETE /identity/v3/users/95abdb6e29fc4d17ba778642d0fdead2 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:12.344852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1148/2261] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:12 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:12.348652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:12.353407 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:12.442469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6458-3b8c-4108-9f27-f570baee203b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:12.448401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d00b90-a7b3-4c16-9c0f-248f0c891efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:12.449015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00b90-a7b3-4c16-9c0f-248f0c891efa admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:12.449293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00b90-a7b3-4c16-9c0f-248f0c891efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:12.449566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d00b90-a7b3-4c16-9c0f-248f0c891efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:12.450267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d00b90-a7b3-4c16-9c0f-248f0c891efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:12.451875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d00b90-a7b3-4c16-9c0f-248f0c891efa admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:12.464353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1114/2262] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:12.467714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03165d2c-fe61-46ae-9041-731f0db77523 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:12.478912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03165d2c-fe61-46ae-9041-731f0db77523 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:12.485239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e1c67-08b0-4e34-939e-25968a56721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:12.485845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e1c67-08b0-4e34-939e-25968a56721d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:12.486134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e1c67-08b0-4e34-939e-25968a56721d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:12.486389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e1c67-08b0-4e34-939e-25968a56721d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:12.487090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e1c67-08b0-4e34-939e-25968a56721d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:12.488791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e1c67-08b0-4e34-939e-25968a56721d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:12.504349 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1149/2263] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:12.505530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d00b90-a7b3-4c16-9c0f-248f0c891efa admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:12.518734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d00b90-a7b3-4c16-9c0f-248f0c891efa admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:12.525222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:12.526391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:12.526391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:12.526782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] PATH_INFO: `/v3/projects/563eaafaf95b4222a5fb69a3414f03db/users/e6c458a523514664aa87d96635732e7b/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:12.543843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=563eaafaf95b4222a5fb69a3414f03db, user_id=e6c458a523514664aa87d96635732e7b, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:12.546775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:12.654439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1115/2264] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:12 2022] PUT /identity/v3/projects/563eaafaf95b4222a5fb69a3414f03db/users/e6c458a523514664aa87d96635732e7b/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:12.667504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8aeff-01a9-4f78-a787-031ddb3c398f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:12.667959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8aeff-01a9-4f78-a787-031ddb3c398f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:12.668288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8aeff-01a9-4f78-a787-031ddb3c398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:12.701940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f7e8aeff-01a9-4f78-a787-031ddb3c398f None None] MFA Rules not processed for user `e6c458a523514664aa87d96635732e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:12.706835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f7e8aeff-01a9-4f78-a787-031ddb3c398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:12.792971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1150/2265] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:12.806835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:12.810523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:12.821989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:12.908860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab51698-ac29-45db-9901-c98509434fce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:12.912498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8831f70-018e-427d-8772-c59558991373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:12.913152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8831f70-018e-427d-8772-c59558991373 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:12.913478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8831f70-018e-427d-8772-c59558991373 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:12.914368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8831f70-018e-427d-8772-c59558991373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:12.927091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8831f70-018e-427d-8772-c59558991373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:12.935277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8831f70-018e-427d-8772-c59558991373 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:12.946139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1116/2266] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:13.013625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8aeff-01a9-4f78-a787-031ddb3c398f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:13.015152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f7e8aeff-01a9-4f78-a787-031ddb3c398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:13.138337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8aeff-01a9-4f78-a787-031ddb3c398f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:13.143300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:13.143993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.144430 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.144696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] PATH_INFO: `/v3/projects/b9d06118effe4f54800e60cca390092c` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.146057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d06118effe4f54800e60cca390092c)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:13.154691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:13.161287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:13.301107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d06118effe4f54800e60cca390092c', 'request_id': 'req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:13.309225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d06118effe4f54800e60cca390092c', 'request_id': 'req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:13.315024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d06118effe4f54800e60cca390092c', 'request_id': 'req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:13.406491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] The token cache is being invalidate because project b9d06118effe4f54800e60cca390092c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:13.406870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:13.412935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:13.412935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1151/2267] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:13 2022] DELETE /identity/v3/projects/b9d06118effe4f54800e60cca390092c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:13.415566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6e0e-a05b-4a40-b370-959d272aafa3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.416053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6e0e-a05b-4a40-b370-959d272aafa3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.416149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6e0e-a05b-4a40-b370-959d272aafa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.437475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3eee6e0e-a05b-4a40-b370-959d272aafa3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:13.438970 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3eee6e0e-a05b-4a40-b370-959d272aafa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:13.473545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:13.475202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:13.536992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1117/2268] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:13.541047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7fd7e-aa89-4e7a-90e6-4a1762b409de admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:13.544648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac6287-47cf-4542-ab61-76f39c411949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:13.545257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6287-47cf-4542-ab61-76f39c411949 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.545541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6287-47cf-4542-ab61-76f39c411949 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.545797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9128daa-c8e2-41bc-a758-f710605caab3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.545902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac6287-47cf-4542-ab61-76f39c411949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.546085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9128daa-c8e2-41bc-a758-f710605caab3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.546360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9128daa-c8e2-41bc-a758-f710605caab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.547900 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5eac6287-47cf-4542-ab61-76f39c411949 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:13.566717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a9128daa-c8e2-41bc-a758-f710605caab3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:13.567942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a9128daa-c8e2-41bc-a758-f710605caab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:13.576167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1118/2269] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:13.580747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9128daa-c8e2-41bc-a758-f710605caab3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:13.590265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9128daa-c8e2-41bc-a758-f710605caab3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:13.595620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:13.596157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.596504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.596773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.597426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:13.597764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:13.599413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:13.615437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1119/2270] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:27:13.617564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:13.618681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac6287-47cf-4542-ab61-76f39c411949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:13.621215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac6287-47cf-4542-ab61-76f39c411949 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:13.628231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba4dc8-ecf2-4321-9099-9d24a40b1e3f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:13.629840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1152/2271] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:27:13.633688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efcaef-0dc9-4c06-b3ef-0a398054a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:13.634308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efcaef-0dc9-4c06-b3ef-0a398054a5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.634658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efcaef-0dc9-4c06-b3ef-0a398054a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.634997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efcaef-0dc9-4c06-b3ef-0a398054a5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.635700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efcaef-0dc9-4c06-b3ef-0a398054a5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:13.638034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efcaef-0dc9-4c06-b3ef-0a398054a5b1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:13.657383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907bf39-832e-46e6-ad71-67c635818753 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.657672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907bf39-832e-46e6-ad71-67c635818753 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.657951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907bf39-832e-46e6-ad71-67c635818753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.681789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d907bf39-832e-46e6-ad71-67c635818753 None None] MFA Rules not processed for user `e0f0bf68631642c197600f557e999adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:13.683012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d907bf39-832e-46e6-ad71-67c635818753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:13.746673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1153/2272] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:13.759025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1120/2273] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:13 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:13.760065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907bf39-832e-46e6-ad71-67c635818753 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:13.771230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907bf39-832e-46e6-ad71-67c635818753 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:13.842775 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a330b98-2925-4596-b4be-4e86246579ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:13.843443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a330b98-2925-4596-b4be-4e86246579ea admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.843727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a330b98-2925-4596-b4be-4e86246579ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.844004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a330b98-2925-4596-b4be-4e86246579ea admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.844699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a330b98-2925-4596-b4be-4e86246579ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:13.846770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a330b98-2925-4596-b4be-4e86246579ea admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:13.927677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1154/2274] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:13 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:13.931245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efcaef-0dc9-4c06-b3ef-0a398054a5b1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:13.945381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efcaef-0dc9-4c06-b3ef-0a398054a5b1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:13.950981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab3a0-2fb8-40f6-83bf-03e536d36812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:13.952098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab3a0-2fb8-40f6-83bf-03e536d36812 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:13.952098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab3a0-2fb8-40f6-83bf-03e536d36812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:13.952357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ab3a0-2fb8-40f6-83bf-03e536d36812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:13.953169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab3a0-2fb8-40f6-83bf-03e536d36812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:13.954996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ab3a0-2fb8-40f6-83bf-03e536d36812 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:13.974738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1121/2275] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:13.984477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a330b98-2925-4596-b4be-4e86246579ea admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:13.995155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a330b98-2925-4596-b4be-4e86246579ea admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:14.002291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d77700-b41d-4430-9f92-599b671987e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:14.002913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77700-b41d-4430-9f92-599b671987e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:14.003191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77700-b41d-4430-9f92-599b671987e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:14.003461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d77700-b41d-4430-9f92-599b671987e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:14.004260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d77700-b41d-4430-9f92-599b671987e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:14.005908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d77700-b41d-4430-9f92-599b671987e2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:14.018216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1155/2276] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:14.022614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab3a0-2fb8-40f6-83bf-03e536d36812 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:14.043310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ab3a0-2fb8-40f6-83bf-03e536d36812 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:14.046829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:14.050055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa0918-e6e9-4bf8-9df2-7c35bdecd336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:14.052505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa0918-e6e9-4bf8-9df2-7c35bdecd336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:14.052897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa0918-e6e9-4bf8-9df2-7c35bdecd336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:14.053361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa0918-e6e9-4bf8-9df2-7c35bdecd336 admin admin] PATH_INFO: `/v3/projects/025ef786602b47168628644274f692c1/users/a821c18da9634d219624aaaa9817958f/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:14.083140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa0918-e6e9-4bf8-9df2-7c35bdecd336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025ef786602b47168628644274f692c1, user_id=a821c18da9634d219624aaaa9817958f, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:14.092011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa0918-e6e9-4bf8-9df2-7c35bdecd336 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:14.212491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1122/2277] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:14 2022] PUT /identity/v3/projects/025ef786602b47168628644274f692c1/users/a821c18da9634d219624aaaa9817958f/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:14.223268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e32a-069b-4c14-b3d9-21ff3b26a019 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:14.223573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e32a-069b-4c14-b3d9-21ff3b26a019 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:14.223848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6e32a-069b-4c14-b3d9-21ff3b26a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:14.255325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3ca6e32a-069b-4c14-b3d9-21ff3b26a019 None None] MFA Rules not processed for user `a821c18da9634d219624aaaa9817958f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:14.256571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3ca6e32a-069b-4c14-b3d9-21ff3b26a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:14.344954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa0918-e6e9-4bf8-9df2-7c35bdecd336 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:14.347257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1156/2278] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:14.386190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:14.420190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa0918-e6e9-4bf8-9df2-7c35bdecd336 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:14.426627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25bfe-55d1-42ad-a823-47d19daa7e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:14.427495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25bfe-55d1-42ad-a823-47d19daa7e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:14.428019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25bfe-55d1-42ad-a823-47d19daa7e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:14.428476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25bfe-55d1-42ad-a823-47d19daa7e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:14.430021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d25bfe-55d1-42ad-a823-47d19daa7e15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:14.433190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d25bfe-55d1-42ad-a823-47d19daa7e15 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:14.563023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1123/2279] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:14 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:14.567254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e32a-069b-4c14-b3d9-21ff3b26a019 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:14.579196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6e32a-069b-4c14-b3d9-21ff3b26a019 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:14.639538 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3abf25-f23f-4925-89c3-6f87ef4ee2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:14.640145 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3abf25-f23f-4925-89c3-6f87ef4ee2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:14.640493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3abf25-f23f-4925-89c3-6f87ef4ee2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:14.640776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3abf25-f23f-4925-89c3-6f87ef4ee2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:14.641426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3abf25-f23f-4925-89c3-6f87ef4ee2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:14.643348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3abf25-f23f-4925-89c3-6f87ef4ee2a9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:14.732077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1157/2280] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:14 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:14.737598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25bfe-55d1-42ad-a823-47d19daa7e15 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:14.749056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25bfe-55d1-42ad-a823-47d19daa7e15 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:14.753869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d930078-d58f-4153-8353-f8c443ed7351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:14.754478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d930078-d58f-4153-8353-f8c443ed7351 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:14.754756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d930078-d58f-4153-8353-f8c443ed7351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:14.755028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d930078-d58f-4153-8353-f8c443ed7351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:14.755813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d930078-d58f-4153-8353-f8c443ed7351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:14.758201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d930078-d58f-4153-8353-f8c443ed7351 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:14.772133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1124/2281] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:14.777079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3abf25-f23f-4925-89c3-6f87ef4ee2a9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:14.789438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3abf25-f23f-4925-89c3-6f87ef4ee2a9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:14.794530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e57f-77eb-4aa6-8b00-af579dd2f5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:14.795210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e57f-77eb-4aa6-8b00-af579dd2f5be admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:14.795493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e57f-77eb-4aa6-8b00-af579dd2f5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:14.795760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e57f-77eb-4aa6-8b00-af579dd2f5be admin admin] PATH_INFO: `/v3/projects/46ad0a935cd84f2989034684b7d4c1ea/users/8d6e6dc3f06b4ac89c988af039c3c83e/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:14.813298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034e57f-77eb-4aa6-8b00-af579dd2f5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ad0a935cd84f2989034684b7d4c1ea, user_id=8d6e6dc3f06b4ac89c988af039c3c83e, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:14.817813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034e57f-77eb-4aa6-8b00-af579dd2f5be admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:14.880842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1158/2282] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:14 2022] PUT /identity/v3/projects/46ad0a935cd84f2989034684b7d4c1ea/users/8d6e6dc3f06b4ac89c988af039c3c83e/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:14.885612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d930078-d58f-4153-8353-f8c443ed7351 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:14.895979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d930078-d58f-4153-8353-f8c443ed7351 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:14.975891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d35b-d330-4cdf-9776-a5a0e1d03d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:14.976594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d35b-d330-4cdf-9776-a5a0e1d03d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:14.976892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d35b-d330-4cdf-9776-a5a0e1d03d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:14.977239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d35b-d330-4cdf-9776-a5a0e1d03d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:14.977895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d35b-d330-4cdf-9776-a5a0e1d03d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:14.979541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d35b-d330-4cdf-9776-a5a0e1d03d57 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:14.993541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1125/2283] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:14.999126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e57f-77eb-4aa6-8b00-af579dd2f5be admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:15.012385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e57f-77eb-4aa6-8b00-af579dd2f5be admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:15.024099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ff2f2-d2cd-4759-b0b1-cb039a185d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:15.024943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ff2f2-d2cd-4759-b0b1-cb039a185d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:15.025178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ff2f2-d2cd-4759-b0b1-cb039a185d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:15.025459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ff2f2-d2cd-4759-b0b1-cb039a185d8e admin admin] PATH_INFO: `/v3/projects/46ad0a935cd84f2989034684b7d4c1ea/users/8d6e6dc3f06b4ac89c988af039c3c83e/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:15.027788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ff2f2-d2cd-4759-b0b1-cb039a185d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ad0a935cd84f2989034684b7d4c1ea, user_id=8d6e6dc3f06b4ac89c988af039c3c83e, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:15.030501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ff2f2-d2cd-4759-b0b1-cb039a185d8e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:15.046149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1159/2284] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:14 2022] PUT /identity/v3/projects/46ad0a935cd84f2989034684b7d4c1ea/users/8d6e6dc3f06b4ac89c988af039c3c83e/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:15.061358 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e883-3906-46ed-b06b-718cd6920acb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:15.066733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e883-3906-46ed-b06b-718cd6920acb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:15.066733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e883-3906-46ed-b06b-718cd6920acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:15.095729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6bf6e883-3906-46ed-b06b-718cd6920acb None None] MFA Rules not processed for user `8d6e6dc3f06b4ac89c988af039c3c83e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:15.097069 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6bf6e883-3906-46ed-b06b-718cd6920acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:15.196207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1126/2285] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:15.245247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ff2f2-d2cd-4759-b0b1-cb039a185d8e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:15.270530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:15.312366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ff2f2-d2cd-4759-b0b1-cb039a185d8e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:15.315957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792ed95-7a9b-4837-aa7c-9dbd2a99399c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:15.316589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792ed95-7a9b-4837-aa7c-9dbd2a99399c service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:15.316870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792ed95-7a9b-4837-aa7c-9dbd2a99399c service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:15.317142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792ed95-7a9b-4837-aa7c-9dbd2a99399c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:15.374074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792ed95-7a9b-4837-aa7c-9dbd2a99399c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:15.375505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792ed95-7a9b-4837-aa7c-9dbd2a99399c service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:15.385294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1160/2286] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:15.714384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e883-3906-46ed-b06b-718cd6920acb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:15.721584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6bf6e883-3906-46ed-b06b-718cd6920acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:15.746493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e883-3906-46ed-b06b-718cd6920acb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:15.751740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:15.752590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:15.752909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:15.753206 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:15.755029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:15.788383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:15.864745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:15.866446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:15.892435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1127/2287] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:17.409483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792ed95-7a9b-4837-aa7c-9dbd2a99399c service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:17.418608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792ed95-7a9b-4837-aa7c-9dbd2a99399c service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:17.422252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6f061-01c2-4ec0-b7d9-8a75cdbe77ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:17.422867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6f061-01c2-4ec0-b7d9-8a75cdbe77ad service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:17.423142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6f061-01c2-4ec0-b7d9-8a75cdbe77ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:17.423434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6f061-01c2-4ec0-b7d9-8a75cdbe77ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:17.433528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6f061-01c2-4ec0-b7d9-8a75cdbe77ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:17.435012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6f061-01c2-4ec0-b7d9-8a75cdbe77ad service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:17.444178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1161/2288] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:21.576629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:21.578375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:21.654241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99496307-c017-40fb-b72a-6abf68309af7 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:21.668408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:21.669054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:21.669328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:21.669600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] PATH_INFO: `/v3/users/d199c056df4348b8970a6880c79a6966` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:21.670744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d199c056df4348b8970a6880c79a6966)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:21.672726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:21.859365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd199c056df4348b8970a6880c79a6966'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:21.869225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd199c056df4348b8970a6880c79a6966'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:21.983046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd199c056df4348b8970a6880c79a6966'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:21.998569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd199c056df4348b8970a6880c79a6966'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:21.999876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd199c056df4348b8970a6880c79a6966'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:22.008736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1128/2289] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:21 2022] DELETE /identity/v3/users/d199c056df4348b8970a6880c79a6966 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:22.021979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ffe6f-b914-4202-ae47-df6feeaa269c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:22.022486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ffe6f-b914-4202-ae47-df6feeaa269c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:22.022567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ffe6f-b914-4202-ae47-df6feeaa269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:22.043379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-712ffe6f-b914-4202-ae47-df6feeaa269c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:22.048424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-712ffe6f-b914-4202-ae47-df6feeaa269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:22.109254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:22.126089 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1162/2290] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:22.136534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:22.138204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:22.204446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:22.216443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b830d7e-43e3-491b-9875-71e65abb74b7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:22.220572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:22.221319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:22.221624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:22.221984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:22.232039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:22.233515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:22.244675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1129/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:22.543449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ffe6f-b914-4202-ae47-df6feeaa269c None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:22.545033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-712ffe6f-b914-4202-ae47-df6feeaa269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:22.563525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ffe6f-b914-4202-ae47-df6feeaa269c None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:22.576252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:22.576252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:22.576252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:22.576252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] PATH_INFO: `/v3/users/a821c18da9634d219624aaaa9817958f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:22.576931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a821c18da9634d219624aaaa9817958f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:22.576931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:22.812607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:22.814613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:22.834095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a821c18da9634d219624aaaa9817958f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:22.850056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f9f7e-3645-4bed-88a4-7f9e7f1de70e service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:22.851370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a821c18da9634d219624aaaa9817958f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:22.855758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:22.856452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:22.856734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:22.857009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] PATH_INFO: `/v3/projects/9ede25ddd70d44398c48d76799a162ee` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:22.858595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ede25ddd70d44398c48d76799a162ee)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:22.861597 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:22.869172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a821c18da9634d219624aaaa9817958f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:22.994295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a821c18da9634d219624aaaa9817958f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:22.994980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1a672c4d-a499-4b04-b42d-30f6ab38b71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a821c18da9634d219624aaaa9817958f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.015323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1163/2292] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:22 2022] DELETE /identity/v3/users/a821c18da9634d219624aaaa9817958f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:23.016890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae595-23d7-438e-a69d-1b776e395389 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:23.017178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae595-23d7-438e-a69d-1b776e395389 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:23.017459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccae595-23d7-438e-a69d-1b776e395389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:23.050375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ede25ddd70d44398c48d76799a162ee', 'request_id': 'req-f6de81ba-2c0a-425d-b9fa-831295def4c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.061804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-bccae595-23d7-438e-a69d-1b776e395389 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:23.063172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bccae595-23d7-438e-a69d-1b776e395389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:23.142662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1164/2293] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:23.152411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccae595-23d7-438e-a69d-1b776e395389 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:23.153717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bccae595-23d7-438e-a69d-1b776e395389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:23.187086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ede25ddd70d44398c48d76799a162ee', 'request_id': 'req-f6de81ba-2c0a-425d-b9fa-831295def4c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.197289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ede25ddd70d44398c48d76799a162ee', 'request_id': 'req-f6de81ba-2c0a-425d-b9fa-831295def4c8'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.215337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] The token cache is being invalidate because project 9ede25ddd70d44398c48d76799a162ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:23.215634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.216969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.217415 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccae595-23d7-438e-a69d-1b776e395389 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:23.221507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1130/2294] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:22 2022] DELETE /identity/v3/projects/9ede25ddd70d44398c48d76799a162ee => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:23.221922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:23.222541 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:23.222853 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:23.223035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:23.223142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:23.224645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:23.230589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:23.237150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:23.238586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:23.242486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de81ba-2c0a-425d-b9fa-831295def4c8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:23.248771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:23.248961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1165/2295] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:27:23.253068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:23.253414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:23.253695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] PATH_INFO: `/v3/users/54e63fce441948b4ac9c84fee5e39398` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:23.255592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e63fce441948b4ac9c84fee5e39398)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:23.259720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:23.471385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e63fce441948b4ac9c84fee5e39398'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.486668 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e63fce441948b4ac9c84fee5e39398'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.594020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e63fce441948b4ac9c84fee5e39398'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.611924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e63fce441948b4ac9c84fee5e39398'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.613216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e63fce441948b4ac9c84fee5e39398'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.623170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1131/2296] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:23 2022] DELETE /identity/v3/users/54e63fce441948b4ac9c84fee5e39398 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:23.714634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:23.717048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:23.735427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1758e4cf-c21f-4965-81f0-1f31061b9d5d service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:23.742471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:23.821157 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:23.821935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:23.822270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:23.822543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] PATH_INFO: `/v3/projects/025ef786602b47168628644274f692c1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:23.828287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=025ef786602b47168628644274f692c1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:23.828287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:23.982296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025ef786602b47168628644274f692c1', 'request_id': 'req-525a50a3-c3ed-4521-850e-39dad64bc051'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.989050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025ef786602b47168628644274f692c1', 'request_id': 'req-525a50a3-c3ed-4521-850e-39dad64bc051'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:23.996228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025ef786602b47168628644274f692c1', 'request_id': 'req-525a50a3-c3ed-4521-850e-39dad64bc051'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.076466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] The token cache is being invalidate because project 025ef786602b47168628644274f692c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:24.076466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.077514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.078786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1166/2297] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:23 2022] DELETE /identity/v3/projects/025ef786602b47168628644274f692c1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:24.082366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:24.083900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:24.099541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a22e-2db7-4940-8c6a-a62a3aef470a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:24.140045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:24.141491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:24.195051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:24.219206 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:24.221064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:24.221669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:24.222175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] PATH_INFO: `/v3/users/8d6e6dc3f06b4ac89c988af039c3c83e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:24.223713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6e6dc3f06b4ac89c988af039c3c83e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:24.228901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:24.282135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a50a3-c3ed-4521-850e-39dad64bc051 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:24.292183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:24.292183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:24.292183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:24.292499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] PATH_INFO: `/v3/projects/043df9f57adf4afe916a9570dde8c6c5` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:24.294270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043df9f57adf4afe916a9570dde8c6c5)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:24.297414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:24.530197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043df9f57adf4afe916a9570dde8c6c5', 'request_id': 'req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.533552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6e6dc3f06b4ac89c988af039c3c83e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.547563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043df9f57adf4afe916a9570dde8c6c5', 'request_id': 'req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.551354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6e6dc3f06b4ac89c988af039c3c83e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.555487 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043df9f57adf4afe916a9570dde8c6c5', 'request_id': 'req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.588606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:24.614348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6e6dc3f06b4ac89c988af039c3c83e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.630384 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6e6dc3f06b4ac89c988af039c3c83e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.631436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6e6dc3f06b4ac89c988af039c3c83e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.638892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1132/2298] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:24 2022] DELETE /identity/v3/users/8d6e6dc3f06b4ac89c988af039c3c83e => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:24.677222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] The token cache is being invalidate because project 043df9f57adf4afe916a9570dde8c6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:24.677629 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.678599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:24.683784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1167/2299] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:24 2022] DELETE /identity/v3/projects/043df9f57adf4afe916a9570dde8c6c5 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:24.685056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:24.686576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:24.767186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0614a38-e040-4d1f-850a-586ce19ffb9e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:24.774335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:24.774940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:24.775223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:24.775493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] PATH_INFO: `/v3/users/d00b5de4cc6449368ec4aee6614baa1e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:24.776706 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00b5de4cc6449368ec4aee6614baa1e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:24.778644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:25.036996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00b5de4cc6449368ec4aee6614baa1e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.044525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00b5de4cc6449368ec4aee6614baa1e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.119545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:25.148451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00b5de4cc6449368ec4aee6614baa1e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.160885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00b5de4cc6449368ec4aee6614baa1e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.161553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b5f4212b-80b8-4cc7-9572-76f87dfe1732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00b5de4cc6449368ec4aee6614baa1e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.167590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1133/2300] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:24 2022] DELETE /identity/v3/users/d00b5de4cc6449368ec4aee6614baa1e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:25.199868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:25.201927 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:25.208752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db302-c527-4a96-8726-9113a4781261 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:25.212417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db302-c527-4a96-8726-9113a4781261 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:25.212695 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90db302-c527-4a96-8726-9113a4781261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:25.253972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a90db302-c527-4a96-8726-9113a4781261 None None] MFA Rules not processed for user `c6c7983040654f15ae92aea3511846de`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:25.255467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a90db302-c527-4a96-8726-9113a4781261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:25.301535 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36bd8e-e011-46c8-a5a6-87d5355f59d7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:25.320510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1134/2301] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:25.369992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:25.370616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:25.370916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:25.371247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] PATH_INFO: `/v3/projects/46ad0a935cd84f2989034684b7d4c1ea` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:25.372385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ad0a935cd84f2989034684b7d4c1ea)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:25.374273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:25.524934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ad0a935cd84f2989034684b7d4c1ea', 'request_id': 'req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.535575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ad0a935cd84f2989034684b7d4c1ea', 'request_id': 'req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.545348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ad0a935cd84f2989034684b7d4c1ea', 'request_id': 'req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.638312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] The token cache is being invalidate because project 46ad0a935cd84f2989034684b7d4c1ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:25.639038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.640032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-1eb56c5c-ec6a-46bb-8a28-014f4213a1c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:25.642260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1168/2302] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:25 2022] DELETE /identity/v3/projects/46ad0a935cd84f2989034684b7d4c1ea => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:25.649883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ef4cb-494f-4a0d-b4eb-55e822bde804 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:25.650497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ef4cb-494f-4a0d-b4eb-55e822bde804 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:25.651023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ef4cb-494f-4a0d-b4eb-55e822bde804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:25.676870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4a8ef4cb-494f-4a0d-b4eb-55e822bde804 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:25.678983 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4a8ef4cb-494f-4a0d-b4eb-55e822bde804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:25.800724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1135/2303] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:25.809063 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488320-5a96-4ff1-bf83-aef973eeb942 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:25.809375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488320-5a96-4ff1-bf83-aef973eeb942 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:25.809659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488320-5a96-4ff1-bf83-aef973eeb942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:25.823443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:25.841269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-aa488320-5a96-4ff1-bf83-aef973eeb942 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:25.842594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa488320-5a96-4ff1-bf83-aef973eeb942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:25.860466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1169/2304] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:25.865329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ef4cb-494f-4a0d-b4eb-55e822bde804 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:25.891048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ef4cb-494f-4a0d-b4eb-55e822bde804 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:25.902485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:25.903236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:25.903580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:25.904001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:25.904789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:25.905164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:25.907020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:25.932467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1136/2305] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:27:25.937466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa488320-5a96-4ff1-bf83-aef973eeb942 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:25.953763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa488320-5a96-4ff1-bf83-aef973eeb942 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:25.959698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634c5d-16a5-4153-a178-b4d47a2cb5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:25.961589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634c5d-16a5-4153-a178-b4d47a2cb5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:25.961898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634c5d-16a5-4153-a178-b4d47a2cb5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:25.962149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d634c5d-16a5-4153-a178-b4d47a2cb5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:25.970035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d634c5d-16a5-4153-a178-b4d47a2cb5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:25.970035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d634c5d-16a5-4153-a178-b4d47a2cb5f7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.047621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.049508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:26.064354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4406-beab-4baa-a262-6848e0b33d57 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.071519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.072437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.072810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.073187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] PATH_INFO: `/v3/projects/dfc44248a75e4d579d8aa36d092ad735` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.074670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc44248a75e4d579d8aa36d092ad735)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.090404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.091324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1170/2306] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:25 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:26.092427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634c5d-16a5-4153-a178-b4d47a2cb5f7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.173354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d634c5d-16a5-4153-a178-b4d47a2cb5f7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.178547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2395fa8-c9dc-4da5-93f0-677f1c6956da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.179681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2395fa8-c9dc-4da5-93f0-677f1c6956da admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.180118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2395fa8-c9dc-4da5-93f0-677f1c6956da admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.180231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2395fa8-c9dc-4da5-93f0-677f1c6956da admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.181380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2395fa8-c9dc-4da5-93f0-677f1c6956da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.189432 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2395fa8-c9dc-4da5-93f0-677f1c6956da admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.232995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc44248a75e4d579d8aa36d092ad735', 'request_id': 'req-cdfe38ee-e1de-45dd-80f9-e0d349092702'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:26.325762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc44248a75e4d579d8aa36d092ad735', 'request_id': 'req-cdfe38ee-e1de-45dd-80f9-e0d349092702'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:26.335024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1171/2307] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:26 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:26.337886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2395fa8-c9dc-4da5-93f0-677f1c6956da admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.339198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc44248a75e4d579d8aa36d092ad735', 'request_id': 'req-cdfe38ee-e1de-45dd-80f9-e0d349092702'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:26.354320 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] The token cache is being invalidate because project dfc44248a75e4d579d8aa36d092ad735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:26.354539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2395fa8-c9dc-4da5-93f0-677f1c6956da admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.354629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:26.355298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-cdfe38ee-e1de-45dd-80f9-e0d349092702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:26.357306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1137/2308] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:26 2022] DELETE /identity/v3/projects/dfc44248a75e4d579d8aa36d092ad735 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:26.367980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfaf10-cb7f-488c-bbb0-d0aca5e83978 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.368489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfaf10-cb7f-488c-bbb0-d0aca5e83978 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.368866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfaf10-cb7f-488c-bbb0-d0aca5e83978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.390823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ebcfaf10-cb7f-488c-bbb0-d0aca5e83978 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:26.392787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ebcfaf10-cb7f-488c-bbb0-d0aca5e83978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:26.421786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.422440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.422725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.422996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.423650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.425290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.435916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1172/2309] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:26.440001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.441765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:26.453452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1138/2310] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:26.453895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7db35a-3835-4ac0-9a60-c21c32d644cc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.458479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190ab86-9b96-42bd-ae98-2578c480467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.459069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190ab86-9b96-42bd-ae98-2578c480467d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.459348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190ab86-9b96-42bd-ae98-2578c480467d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.459622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190ab86-9b96-42bd-ae98-2578c480467d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.460375 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190ab86-9b96-42bd-ae98-2578c480467d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.461279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54b888-a3a0-46ea-bd56-488a62f47789 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.461567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54b888-a3a0-46ea-bd56-488a62f47789 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.461845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54b888-a3a0-46ea-bd56-488a62f47789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.461949 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190ab86-9b96-42bd-ae98-2578c480467d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.484205 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-0e54b888-a3a0-46ea-bd56-488a62f47789 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:26.485565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0e54b888-a3a0-46ea-bd56-488a62f47789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:26.488829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1173/2311] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:26.494557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190ab86-9b96-42bd-ae98-2578c480467d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.508345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1139/2312] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:26.513165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54b888-a3a0-46ea-bd56-488a62f47789 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.513554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190ab86-9b96-42bd-ae98-2578c480467d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.520198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a969-1cac-4fe0-a86a-3e8a07b416f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.521136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a969-1cac-4fe0-a86a-3e8a07b416f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.521449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a969-1cac-4fe0-a86a-3e8a07b416f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.521692 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a969-1cac-4fe0-a86a-3e8a07b416f6 admin admin] PATH_INFO: `/v3/projects/c9bed88c30a548ee8a1a101891dd6837/users/2bab51b1620049d9ace1e212ed99922f/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.525602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54b888-a3a0-46ea-bd56-488a62f47789 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.532045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.532875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.533317 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.533720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.534655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:26.535191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.537214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.541908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50a969-1cac-4fe0-a86a-3e8a07b416f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bed88c30a548ee8a1a101891dd6837, user_id=2bab51b1620049d9ace1e212ed99922f, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.544891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50a969-1cac-4fe0-a86a-3e8a07b416f6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.550642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1140/2313] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:27:26.555932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.565971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ae121-8b5b-424e-a8ed-f82fcfc0f5d4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.571577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4110f-8411-4147-986d-f7a54e3fa0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.572182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4110f-8411-4147-986d-f7a54e3fa0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.572487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4110f-8411-4147-986d-f7a54e3fa0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.572963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4110f-8411-4147-986d-f7a54e3fa0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.573592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4110f-8411-4147-986d-f7a54e3fa0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.575492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4110f-8411-4147-986d-f7a54e3fa0e4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.634919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1174/2314] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:26 2022] PUT /identity/v3/projects/c9bed88c30a548ee8a1a101891dd6837/users/2bab51b1620049d9ace1e212ed99922f/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:26.640032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3e79-a86c-4bb2-9095-18f0e6df6133 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.640615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3e79-a86c-4bb2-9095-18f0e6df6133 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.641064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3e79-a86c-4bb2-9095-18f0e6df6133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.670863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-078b3e79-a86c-4bb2-9095-18f0e6df6133 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:26.672165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-078b3e79-a86c-4bb2-9095-18f0e6df6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:26.692888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1141/2315] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:26 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:26.697642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4110f-8411-4147-986d-f7a54e3fa0e4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.754711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1175/2316] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:26.765934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b3e79-a86c-4bb2-9095-18f0e6df6133 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.768517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-078b3e79-a86c-4bb2-9095-18f0e6df6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:26.788792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4110f-8411-4147-986d-f7a54e3fa0e4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.795034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe15fb-96d5-4841-8611-c63764aff906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.795960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe15fb-96d5-4841-8611-c63764aff906 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.796406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe15fb-96d5-4841-8611-c63764aff906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.796699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe15fb-96d5-4841-8611-c63764aff906 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.798015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe15fb-96d5-4841-8611-c63764aff906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.799615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe15fb-96d5-4841-8611-c63764aff906 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.831521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b3e79-a86c-4bb2-9095-18f0e6df6133 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.881003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e801-5f9c-4899-b9b3-e6961a1699d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.881634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e801-5f9c-4899-b9b3-e6961a1699d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.882030 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e801-5f9c-4899-b9b3-e6961a1699d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.882444 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e801-5f9c-4899-b9b3-e6961a1699d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.891773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e801-5f9c-4899-b9b3-e6961a1699d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.893230 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82e801-5f9c-4899-b9b3-e6961a1699d9 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.903892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1176/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:27:26.917382 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1142/2318] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:26 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:26.921579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e801-5f9c-4899-b9b3-e6961a1699d9 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.931169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e801-5f9c-4899-b9b3-e6961a1699d9 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.935803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903b0a8-7199-408f-95ac-48e5b31d78b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.936422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b0a8-7199-408f-95ac-48e5b31d78b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.936700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b0a8-7199-408f-95ac-48e5b31d78b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.936972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903b0a8-7199-408f-95ac-48e5b31d78b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.940373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903b0a8-7199-408f-95ac-48e5b31d78b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.940373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903b0a8-7199-408f-95ac-48e5b31d78b4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.949196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1177/2319] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:26.953365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe15fb-96d5-4841-8611-c63764aff906 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.964774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe15fb-96d5-4841-8611-c63764aff906 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:26.969383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:26.969980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:26.970261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:26.970533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:26.971304 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:26.972946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:26.984164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1143/2320] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:26.988270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903b0a8-7199-408f-95ac-48e5b31d78b4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:26.998824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903b0a8-7199-408f-95ac-48e5b31d78b4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:27.003788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0a391-2151-45fc-a9a3-38fb9a92ca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:27.016268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0a391-2151-45fc-a9a3-38fb9a92ca0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:27.016268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0a391-2151-45fc-a9a3-38fb9a92ca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:27.016268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0a391-2151-45fc-a9a3-38fb9a92ca0f admin admin] PATH_INFO: `/v3/projects/346409b0b148490f94a7c2faf26eca07/users/38b014214aeb48218e2223817fc655fb/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:27.030564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0a391-2151-45fc-a9a3-38fb9a92ca0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=346409b0b148490f94a7c2faf26eca07, user_id=38b014214aeb48218e2223817fc655fb, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:27.033370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0a391-2151-45fc-a9a3-38fb9a92ca0f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:27.119917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:27.124150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:27.124343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1178/2321] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:26 2022] PUT /identity/v3/projects/346409b0b148490f94a7c2faf26eca07/users/38b014214aeb48218e2223817fc655fb/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:27.127794 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5ba11-32a5-4c28-ba71-d2e34dea1b58 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:27.128649 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5ba11-32a5-4c28-ba71-d2e34dea1b58 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:27.128935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5ba11-32a5-4c28-ba71-d2e34dea1b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:27.151523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64c44f-52b7-4862-963e-b9242b0cfce1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:27.170996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a8e5ba11-32a5-4c28-ba71-d2e34dea1b58 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:27.172245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a8e5ba11-32a5-4c28-ba71-d2e34dea1b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:27.228920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:27.230037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:27.230631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:27.232453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:27.236550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] PATH_INFO: `/v3/users/e6c458a523514664aa87d96635732e7b` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:27.236550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c458a523514664aa87d96635732e7b)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:27.236550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:27.251281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1179/2322] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:27.269660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5ba11-32a5-4c28-ba71-d2e34dea1b58 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:27.338708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5ba11-32a5-4c28-ba71-d2e34dea1b58 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:27.342782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29a8a8-ec02-43d9-a051-6a27b18d4492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:27.343622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a8a8-ec02-43d9-a051-6a27b18d4492 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:27.344183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a8a8-ec02-43d9-a051-6a27b18d4492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:27.344715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a8a8-ec02-43d9-a051-6a27b18d4492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:27.356548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a8a8-ec02-43d9-a051-6a27b18d4492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:27.358123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a8a8-ec02-43d9-a051-6a27b18d4492 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:27.369200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1180/2323] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:27:27.412612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c458a523514664aa87d96635732e7b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:27.420137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c458a523514664aa87d96635732e7b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:27.547452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c458a523514664aa87d96635732e7b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:27.563041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c458a523514664aa87d96635732e7b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:27.563824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c458a523514664aa87d96635732e7b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:27.570450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1144/2324] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:27 2022] DELETE /identity/v3/users/e6c458a523514664aa87d96635732e7b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:27.575198 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9ee9-0a98-47fa-8d55-fc4974359092 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:27.575485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9ee9-0a98-47fa-8d55-fc4974359092 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:27.575767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9ee9-0a98-47fa-8d55-fc4974359092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:27.596280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-973a9ee9-0a98-47fa-8d55-fc4974359092 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:27.597623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-973a9ee9-0a98-47fa-8d55-fc4974359092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:27.664977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1181/2325] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:27.676455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:27.677992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:27.778197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e814-dfcb-4a22-8489-325d520b31d6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:27.787212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a5eda-c8e8-4f07-9030-e80c60734226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:27.787848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a5eda-c8e8-4f07-9030-e80c60734226 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:27.788185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a5eda-c8e8-4f07-9030-e80c60734226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:27.788539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a5eda-c8e8-4f07-9030-e80c60734226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:27.799348 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a5eda-c8e8-4f07-9030-e80c60734226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:27.801531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a5eda-c8e8-4f07-9030-e80c60734226 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:27.813311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1145/2326] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:28.212137 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:28.409793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9ee9-0a98-47fa-8d55-fc4974359092 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:28.412006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-973a9ee9-0a98-47fa-8d55-fc4974359092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:28.428515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9ee9-0a98-47fa-8d55-fc4974359092 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:28.435322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:28.436391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:28.436807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:28.437211 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] PATH_INFO: `/v3/projects/563eaafaf95b4222a5fb69a3414f03db` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:28.440887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563eaafaf95b4222a5fb69a3414f03db)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:28.444196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:28.602957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563eaafaf95b4222a5fb69a3414f03db', 'request_id': 'req-cbde747d-9f4a-4d65-8504-49937ebb3b95'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:28.610778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563eaafaf95b4222a5fb69a3414f03db', 'request_id': 'req-cbde747d-9f4a-4d65-8504-49937ebb3b95'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:28.619589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563eaafaf95b4222a5fb69a3414f03db', 'request_id': 'req-cbde747d-9f4a-4d65-8504-49937ebb3b95'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:28.746286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] The token cache is being invalidate because project 563eaafaf95b4222a5fb69a3414f03db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:28.746673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:28.750135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:28.767545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1182/2327] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:28 2022] DELETE /identity/v3/projects/563eaafaf95b4222a5fb69a3414f03db => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:29.051280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:29.279654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd9a9-46b4-4cfb-b0c1-56766311522f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:29.279654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd9a9-46b4-4cfb-b0c1-56766311522f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:29.279654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd9a9-46b4-4cfb-b0c1-56766311522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:29.322879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-259fd9a9-46b4-4cfb-b0c1-56766311522f None None] MFA Rules not processed for user `38b014214aeb48218e2223817fc655fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:29.324527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-259fd9a9-46b4-4cfb-b0c1-56766311522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:29.337545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:29.456977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1146/2328] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:29.467220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:29.468905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:29.582826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde747d-9f4a-4d65-8504-49937ebb3b95 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:29.588048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28ced6-618e-4465-9bbc-ff51b1cb17b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:29.589948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28ced6-618e-4465-9bbc-ff51b1cb17b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:29.589948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28ced6-618e-4465-9bbc-ff51b1cb17b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:29.589948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28ced6-618e-4465-9bbc-ff51b1cb17b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:29.610177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28ced6-618e-4465-9bbc-ff51b1cb17b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:29.611870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28ced6-618e-4465-9bbc-ff51b1cb17b6 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:29.634416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1183/2329] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:30.041328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fd9a9-46b4-4cfb-b0c1-56766311522f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:30.041328 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-259fd9a9-46b4-4cfb-b0c1-56766311522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:30.166524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fd9a9-46b4-4cfb-b0c1-56766311522f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:30.180353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:30.180353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:30.180353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:30.180353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] PATH_INFO: `/v3/users/691e59b3d88146f5b5352eb2bb2258f1` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:30.180862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=691e59b3d88146f5b5352eb2bb2258f1)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:30.180862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:30.741709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '691e59b3d88146f5b5352eb2bb2258f1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:30.757337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '691e59b3d88146f5b5352eb2bb2258f1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:30.872474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '691e59b3d88146f5b5352eb2bb2258f1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:30.891555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '691e59b3d88146f5b5352eb2bb2258f1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:30.892606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '691e59b3d88146f5b5352eb2bb2258f1'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:30.899839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1147/2330] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:30 2022] DELETE /identity/v3/users/691e59b3d88146f5b5352eb2bb2258f1 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:30.904575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817fe87-a558-4ea3-80c0-2a846a639d72 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:30.905115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817fe87-a558-4ea3-80c0-2a846a639d72 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:30.905331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817fe87-a558-4ea3-80c0-2a846a639d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:30.950206 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0817fe87-a558-4ea3-80c0-2a846a639d72 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:30.954049 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0817fe87-a558-4ea3-80c0-2a846a639d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:30.995047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:31.063350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1184/2331] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:31.072232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:31.073974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:31.151220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba8352-5cab-46cb-83a1-467d7c335369 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:31.155787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1732c-7446-4910-a37c-97adaaccdb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:31.156671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1732c-7446-4910-a37c-97adaaccdb46 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:31.157010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1732c-7446-4910-a37c-97adaaccdb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:31.157369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1732c-7446-4910-a37c-97adaaccdb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:31.167995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1732c-7446-4910-a37c-97adaaccdb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:31.169624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1732c-7446-4910-a37c-97adaaccdb46 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:31.181817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1148/2332] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:31.348388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:31.734683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817fe87-a558-4ea3-80c0-2a846a639d72 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:31.736368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0817fe87-a558-4ea3-80c0-2a846a639d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:31.750588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817fe87-a558-4ea3-80c0-2a846a639d72 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:31.757508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:31.760576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:31.760576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:31.760576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] PATH_INFO: `/v3/projects/9f7270257e0149d4b89abd73aff3fc1d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:31.760576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7270257e0149d4b89abd73aff3fc1d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:31.763137 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:31.869882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7270257e0149d4b89abd73aff3fc1d', 'request_id': 'req-e9544b3f-4c29-4723-9804-4ac69ab608a8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:31.877565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7270257e0149d4b89abd73aff3fc1d', 'request_id': 'req-e9544b3f-4c29-4723-9804-4ac69ab608a8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:31.886352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7270257e0149d4b89abd73aff3fc1d', 'request_id': 'req-e9544b3f-4c29-4723-9804-4ac69ab608a8'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:31.949228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] The token cache is being invalidate because project 9f7270257e0149d4b89abd73aff3fc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:31.950626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:31.951309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e9544b3f-4c29-4723-9804-4ac69ab608a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:31.953060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1185/2333] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:31 2022] DELETE /identity/v3/projects/9f7270257e0149d4b89abd73aff3fc1d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:31.957996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0129e7-d312-4ca1-ad41-5f04c2423cc1 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:31.958287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0129e7-d312-4ca1-ad41-5f04c2423cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:31.958562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0129e7-d312-4ca1-ad41-5f04c2423cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:31.981896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8d0129e7-d312-4ca1-ad41-5f04c2423cc1 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:31.983484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8d0129e7-d312-4ca1-ad41-5f04c2423cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:32.067492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1149/2334] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:32.090270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ca52-143d-4895-80f5-23da82392a0a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.094827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ca52-143d-4895-80f5-23da82392a0a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.094827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264ca52-143d-4895-80f5-23da82392a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.096699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0f134-f7c4-4a28-ba61-f260fc44d999 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.096989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0f134-f7c4-4a28-ba61-f260fc44d999 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.097268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0f134-f7c4-4a28-ba61-f260fc44d999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.111964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2264ca52-143d-4895-80f5-23da82392a0a None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:32.113497 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2264ca52-143d-4895-80f5-23da82392a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:32.118972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-04d0f134-f7c4-4a28-ba61-f260fc44d999 None None] MFA Rules not processed for user `38b014214aeb48218e2223817fc655fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:32.120252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-04d0f134-f7c4-4a28-ba61-f260fc44d999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:32.123285 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1186/2335] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:32.127008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ca52-143d-4895-80f5-23da82392a0a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:32.138818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264ca52-143d-4895-80f5-23da82392a0a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:32.143704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:32.144590 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.145026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.145451 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.146114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:32.146445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:32.149107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:32.166008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1187/2336] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:27:32.167580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:32.178094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7aa0-4e84-4365-ba2d-6365fbb88cc3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:32.185025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b25a1-2263-4845-a8c3-531b3cd1b930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:32.185864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b25a1-2263-4845-a8c3-531b3cd1b930 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.186239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b25a1-2263-4845-a8c3-531b3cd1b930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.186653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b25a1-2263-4845-a8c3-531b3cd1b930 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.187569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b25a1-2263-4845-a8c3-531b3cd1b930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:32.189339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b25a1-2263-4845-a8c3-531b3cd1b930 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:32.196694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1150/2337] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:32.281292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1188/2338] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:32 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:32.285862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0f134-f7c4-4a28-ba61-f260fc44d999 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:32.296915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0f134-f7c4-4a28-ba61-f260fc44d999 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:32.358414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c07d-d5bb-4cae-ac9a-0c5707f998e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:32.359040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c07d-d5bb-4cae-ac9a-0c5707f998e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.359324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c07d-d5bb-4cae-ac9a-0c5707f998e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.359599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c07d-d5bb-4cae-ac9a-0c5707f998e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.360533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38c07d-d5bb-4cae-ac9a-0c5707f998e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:32.362363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38c07d-d5bb-4cae-ac9a-0c5707f998e4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:32.423060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1151/2339] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:32 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:32.427653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b25a1-2263-4845-a8c3-531b3cd1b930 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:32.435164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:32.441651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b25a1-2263-4845-a8c3-531b3cd1b930 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:32.447555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b021c34-0e91-4d06-ba8c-fe339870a92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:32.448720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b021c34-0e91-4d06-ba8c-fe339870a92b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.449094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b021c34-0e91-4d06-ba8c-fe339870a92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.449485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b021c34-0e91-4d06-ba8c-fe339870a92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.450463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b021c34-0e91-4d06-ba8c-fe339870a92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:32.452218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b021c34-0e91-4d06-ba8c-fe339870a92b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:32.464802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1189/2340] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:32.469094 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c07d-d5bb-4cae-ac9a-0c5707f998e4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:32.480234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c07d-d5bb-4cae-ac9a-0c5707f998e4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:32.485220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fa42a-36b2-42de-9420-149e767275bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:32.485837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fa42a-36b2-42de-9420-149e767275bc admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.486113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fa42a-36b2-42de-9420-149e767275bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.486383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fa42a-36b2-42de-9420-149e767275bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.487238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fa42a-36b2-42de-9420-149e767275bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:32.488900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fa42a-36b2-42de-9420-149e767275bc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:32.501373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1152/2341] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:32.506482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b021c34-0e91-4d06-ba8c-fe339870a92b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:32.519409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:32.519813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b021c34-0e91-4d06-ba8c-fe339870a92b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:32.525481 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:32.526972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.526972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.526972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] PATH_INFO: `/v3/projects/0ea0245a78e34d378c9460964cdb2052/users/5e6a15e7068644a79cfd9aa085ff590e/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.546671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea0245a78e34d378c9460964cdb2052, user_id=5e6a15e7068644a79cfd9aa085ff590e, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:32.550320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:32.634733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1190/2342] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:32 2022] PUT /identity/v3/projects/0ea0245a78e34d378c9460964cdb2052/users/5e6a15e7068644a79cfd9aa085ff590e/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:32.645449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722ac9-facd-4839-9184-aeb47767d606 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.645826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722ac9-facd-4839-9184-aeb47767d606 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.646160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3722ac9-facd-4839-9184-aeb47767d606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.675524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d3722ac9-facd-4839-9184-aeb47767d606 None None] MFA Rules not processed for user `5e6a15e7068644a79cfd9aa085ff590e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:32.676898 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d3722ac9-facd-4839-9184-aeb47767d606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:32.769032 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1153/2343] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:32.777605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:32.779344 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:32.852381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1bdb7-bcc3-4cac-bcc9-e81208d5df6e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:32.856581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66391e-3e54-41c1-824c-c4aa9980fe92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:32.856978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66391e-3e54-41c1-824c-c4aa9980fe92 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.857257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66391e-3e54-41c1-824c-c4aa9980fe92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.857530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66391e-3e54-41c1-824c-c4aa9980fe92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.867779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66391e-3e54-41c1-824c-c4aa9980fe92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:32.869325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66391e-3e54-41c1-824c-c4aa9980fe92 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:32.878503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1191/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:32.889781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:32.907440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3722ac9-facd-4839-9184-aeb47767d606 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:32.977729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3722ac9-facd-4839-9184-aeb47767d606 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:32.981553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:32.982220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:32.982487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:32.982762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] PATH_INFO: `/v3/users/5e6a15e7068644a79cfd9aa085ff590e` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:32.983933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6a15e7068644a79cfd9aa085ff590e)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:32.985897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:33.219818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6a15e7068644a79cfd9aa085ff590e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:33.232767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6a15e7068644a79cfd9aa085ff590e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:33.313638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6a15e7068644a79cfd9aa085ff590e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:33.330478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6a15e7068644a79cfd9aa085ff590e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:33.331219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6a15e7068644a79cfd9aa085ff590e'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:33.340110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1154/2345] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:27:32 2022] DELETE /identity/v3/users/5e6a15e7068644a79cfd9aa085ff590e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:33.344963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c146-8991-4a5d-bac1-6d9fea1c34aa None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:33.345829 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c146-8991-4a5d-bac1-6d9fea1c34aa None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:33.346172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c146-8991-4a5d-bac1-6d9fea1c34aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:33.375106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3223c146-8991-4a5d-bac1-6d9fea1c34aa None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:33.376400 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3223c146-8991-4a5d-bac1-6d9fea1c34aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:33.487598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1192/2346] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:33.495486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:33.496950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:33.546291 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:33.566180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d495dd9-fc84-46df-8d48-442fac972b79 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:33.570525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168470c-0c92-4d2e-bf76-ed264719f889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:33.571129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168470c-0c92-4d2e-bf76-ed264719f889 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:33.571414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168470c-0c92-4d2e-bf76-ed264719f889 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:33.571686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168470c-0c92-4d2e-bf76-ed264719f889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:33.582492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168470c-0c92-4d2e-bf76-ed264719f889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:33.584276 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168470c-0c92-4d2e-bf76-ed264719f889 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:33.597152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1155/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:34.287878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223c146-8991-4a5d-bac1-6d9fea1c34aa None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:34.292013 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3223c146-8991-4a5d-bac1-6d9fea1c34aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:34.308601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223c146-8991-4a5d-bac1-6d9fea1c34aa None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:34.370960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:34.372578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:34.373019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:34.373443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] PATH_INFO: `/v3/projects/0ea0245a78e34d378c9460964cdb2052` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:34.375419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea0245a78e34d378c9460964cdb2052)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:34.377867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:34.567175 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea0245a78e34d378c9460964cdb2052', 'request_id': 'req-cafebda9-71d2-4486-b8d5-ac8caa49ce80'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:34.576719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea0245a78e34d378c9460964cdb2052', 'request_id': 'req-cafebda9-71d2-4486-b8d5-ac8caa49ce80'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:34.608027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea0245a78e34d378c9460964cdb2052', 'request_id': 'req-cafebda9-71d2-4486-b8d5-ac8caa49ce80'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:34.613311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:34.661999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] The token cache is being invalidate because project 0ea0245a78e34d378c9460964cdb2052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:27:34.662298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:34.664940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-cafebda9-71d2-4486-b8d5-ac8caa49ce80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:27:34.672564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1193/2348] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:27:34 2022] DELETE /identity/v3/projects/0ea0245a78e34d378c9460964cdb2052 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:34.677874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80534-509a-4843-943b-e66e191b701b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:34.679877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80534-509a-4843-943b-e66e191b701b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:34.680486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb80534-509a-4843-943b-e66e191b701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:34.708189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-feb80534-509a-4843-943b-e66e191b701b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:34.710745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-feb80534-509a-4843-943b-e66e191b701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:34.815589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1156/2349] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:34.823881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039be3a-b701-4cdb-b7ef-2a79411f69c1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:34.824863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039be3a-b701-4cdb-b7ef-2a79411f69c1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:34.825372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039be3a-b701-4cdb-b7ef-2a79411f69c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:34.861966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e039be3a-b701-4cdb-b7ef-2a79411f69c1 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:34.863528 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e039be3a-b701-4cdb-b7ef-2a79411f69c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:34.912324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1194/2350] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:34.917026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb80534-509a-4843-943b-e66e191b701b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:34.933980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb80534-509a-4843-943b-e66e191b701b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:34.943830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:34.946234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:34.946749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:34.947280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:34.948150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:27:34.948735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:34.950573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:34.969327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1157/2351] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:27:34.973870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039be3a-b701-4cdb-b7ef-2a79411f69c1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:35.000882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039be3a-b701-4cdb-b7ef-2a79411f69c1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:35.013661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9225b-6557-42c6-b93f-965924a81ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:35.013661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9225b-6557-42c6-b93f-965924a81ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:35.013661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9225b-6557-42c6-b93f-965924a81ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:35.013661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9225b-6557-42c6-b93f-965924a81ab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:35.013978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9225b-6557-42c6-b93f-965924a81ab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:35.013978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9225b-6557-42c6-b93f-965924a81ab4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:35.169153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1195/2352] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:34 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:35.173296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:35.187411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b0de5-11d4-41ae-a20a-44e0af5af112 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:35.281821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca415d-95a6-4301-8dbc-30db58ac2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:35.282472 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca415d-95a6-4301-8dbc-30db58ac2190 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:35.285242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca415d-95a6-4301-8dbc-30db58ac2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:35.285242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca415d-95a6-4301-8dbc-30db58ac2190 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:35.285242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca415d-95a6-4301-8dbc-30db58ac2190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:35.286002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca415d-95a6-4301-8dbc-30db58ac2190 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:35.388716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1158/2353] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:35 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:35.389882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9225b-6557-42c6-b93f-965924a81ab4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:35.401963 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9225b-6557-42c6-b93f-965924a81ab4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:35.410765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0f5f4-7c47-480e-ba8d-1369305d2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:35.412031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0f5f4-7c47-480e-ba8d-1369305d2f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:35.412569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0f5f4-7c47-480e-ba8d-1369305d2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:35.414356 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0f5f4-7c47-480e-ba8d-1369305d2f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:35.415906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0f5f4-7c47-480e-ba8d-1369305d2f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:35.419554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0f5f4-7c47-480e-ba8d-1369305d2f96 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:35.443599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1196/2354] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:27:35.447552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca415d-95a6-4301-8dbc-30db58ac2190 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:35.459144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca415d-95a6-4301-8dbc-30db58ac2190 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:35.465647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4066f-d385-418f-8260-70727c0f9c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:35.466218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4066f-d385-418f-8260-70727c0f9c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:35.466522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4066f-d385-418f-8260-70727c0f9c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:35.466890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4066f-d385-418f-8260-70727c0f9c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:35.467549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4066f-d385-418f-8260-70727c0f9c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:35.470039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4066f-d385-418f-8260-70727c0f9c35 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:35.488752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1159/2355] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:35.489213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0f5f4-7c47-480e-ba8d-1369305d2f96 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:35.501359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0f5f4-7c47-480e-ba8d-1369305d2f96 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:35.508752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:35.510107 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:35.510582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:35.511034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] PATH_INFO: `/v3/projects/80a873712c224e929d7f03d0d9a14bdc/users/851997d2ffc74b6397e3d4fb82684049/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:35.543573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a873712c224e929d7f03d0d9a14bdc, user_id=851997d2ffc74b6397e3d4fb82684049, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:35.551428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:35.655715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1197/2356] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:35 2022] PUT /identity/v3/projects/80a873712c224e929d7f03d0d9a14bdc/users/851997d2ffc74b6397e3d4fb82684049/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:27:35.661181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207df4b-a8e1-4611-9878-346330fbcfac None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:35.661572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207df4b-a8e1-4611-9878-346330fbcfac None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:35.661911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207df4b-a8e1-4611-9878-346330fbcfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:35.686513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9207df4b-a8e1-4611-9878-346330fbcfac None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:35.688545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9207df4b-a8e1-4611-9878-346330fbcfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:35.745020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:35.766172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1160/2357] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:35.776936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:35.778844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:35.871919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fcf37-28db-49a6-9a81-55bf4c8243b5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:35.878772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:35.879336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:35.879677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:35.880741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:35.895929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:35.897952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:35.950641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1198/2358] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:37.596454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48499397-0cde-46b2-9bb4-56565dc80797 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:37.596454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48499397-0cde-46b2-9bb4-56565dc80797 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:37.596454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48499397-0cde-46b2-9bb4-56565dc80797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:37.664835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-48499397-0cde-46b2-9bb4-56565dc80797 None None] MFA Rules not processed for user `851997d2ffc74b6397e3d4fb82684049`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:37.666138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-48499397-0cde-46b2-9bb4-56565dc80797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:37.767655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1161/2359] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:37.779803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:37.781362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:37.864539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11b2f8-6eed-472c-b250-2988fecc5798 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:37.871382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:37.872011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:37.872315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:37.872606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:37.883300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:37.884542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:37.895287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1199/2360] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:38.549759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bc00-2fc0-4881-b134-6b7d0e60855c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:38.550538 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bc00-2fc0-4881-b134-6b7d0e60855c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:38.550926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270bc00-2fc0-4881-b134-6b7d0e60855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:38.582420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7270bc00-2fc0-4881-b134-6b7d0e60855c None None] MFA Rules not processed for user `2bab51b1620049d9ace1e212ed99922f`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:38.583937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7270bc00-2fc0-4881-b134-6b7d0e60855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:38.681312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1162/2361] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:38.685510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:38.687638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:38.722371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f7199-80ed-4780-a650-f031b13ad3be service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:38.741519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492e7f-11fd-431c-a695-08486d9630ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:38.743592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492e7f-11fd-431c-a695-08486d9630ce admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:38.744121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492e7f-11fd-431c-a695-08486d9630ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:38.744583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad492e7f-11fd-431c-a695-08486d9630ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:38.745767 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492e7f-11fd-431c-a695-08486d9630ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:38.748045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad492e7f-11fd-431c-a695-08486d9630ce admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:38.847258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1200/2362] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:27:38 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:27:38.851961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270bc00-2fc0-4881-b134-6b7d0e60855c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:38.872046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270bc00-2fc0-4881-b134-6b7d0e60855c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:38.949686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea149c-752a-44a7-af14-81c8c6f874f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:38.950571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea149c-752a-44a7-af14-81c8c6f874f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:38.950725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea149c-752a-44a7-af14-81c8c6f874f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:38.950937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea149c-752a-44a7-af14-81c8c6f874f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:38.951593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea149c-752a-44a7-af14-81c8c6f874f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:38.953853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea149c-752a-44a7-af14-81c8c6f874f6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:38.967002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:39.057967 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1163/2363] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:27:38 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:27:39.061720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492e7f-11fd-431c-a695-08486d9630ce admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:39.074816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad492e7f-11fd-431c-a695-08486d9630ce admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:39.079960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ef84f-caa5-4feb-8db1-c43ee5d1b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:39.080874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ef84f-caa5-4feb-8db1-c43ee5d1b2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:39.081155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ef84f-caa5-4feb-8db1-c43ee5d1b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:39.081572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ef84f-caa5-4feb-8db1-c43ee5d1b2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:39.082416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ef84f-caa5-4feb-8db1-c43ee5d1b2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:39.084069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ef84f-caa5-4feb-8db1-c43ee5d1b2b0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:39.096790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1201/2364] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:39.101389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea149c-752a-44a7-af14-81c8c6f874f6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:39.112962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea149c-752a-44a7-af14-81c8c6f874f6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:39.121269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c408-71f6-4319-ab0f-788644ace442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:39.123638 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c408-71f6-4319-ab0f-788644ace442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:39.123974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c408-71f6-4319-ab0f-788644ace442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:39.124259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c408-71f6-4319-ab0f-788644ace442 admin admin] PATH_INFO: `/v3/projects/a19666692db64e959200ec5c5d65a3dc/users/f571c879727140d6892208df5408ee74/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:39.140392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4c408-71f6-4319-ab0f-788644ace442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19666692db64e959200ec5c5d65a3dc, user_id=f571c879727140d6892208df5408ee74, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:39.143113 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4c408-71f6-4319-ab0f-788644ace442 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:39.218871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1164/2365] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:39 2022] PUT /identity/v3/projects/a19666692db64e959200ec5c5d65a3dc/users/f571c879727140d6892208df5408ee74/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:39.222777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ef84f-caa5-4feb-8db1-c43ee5d1b2b0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:39.228985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:39.234390 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ef84f-caa5-4feb-8db1-c43ee5d1b2b0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:39.301663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b13f2a-6e96-40f9-a4e2-b8cc6e6610bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:39.302359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13f2a-6e96-40f9-a4e2-b8cc6e6610bc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:39.302709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13f2a-6e96-40f9-a4e2-b8cc6e6610bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:39.303193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b13f2a-6e96-40f9-a4e2-b8cc6e6610bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:39.304500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b13f2a-6e96-40f9-a4e2-b8cc6e6610bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:39.306156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b13f2a-6e96-40f9-a4e2-b8cc6e6610bc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:39.325216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1202/2366] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:27:39.329504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c408-71f6-4319-ab0f-788644ace442 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:39.340816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c408-71f6-4319-ab0f-788644ace442 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:39.345666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e973a15-e402-46ea-9ed5-0ee8bfa0e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:39.346460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973a15-e402-46ea-9ed5-0ee8bfa0e5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:39.346758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973a15-e402-46ea-9ed5-0ee8bfa0e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:39.346993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e973a15-e402-46ea-9ed5-0ee8bfa0e5c4 admin admin] PATH_INFO: `/v3/projects/a19666692db64e959200ec5c5d65a3dc/users/f571c879727140d6892208df5408ee74/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:39.349017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e973a15-e402-46ea-9ed5-0ee8bfa0e5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19666692db64e959200ec5c5d65a3dc, user_id=f571c879727140d6892208df5408ee74, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:39.352970 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e973a15-e402-46ea-9ed5-0ee8bfa0e5c4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:39.363401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1165/2367] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:27:39 2022] PUT /identity/v3/projects/a19666692db64e959200ec5c5d65a3dc/users/f571c879727140d6892208df5408ee74/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:27:39.652911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6491-f0f7-4ae9-bd11-39aca4f69434 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:39.652911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6491-f0f7-4ae9-bd11-39aca4f69434 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:39.652911 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b6491-f0f7-4ae9-bd11-39aca4f69434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:39.675330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d14b6491-f0f7-4ae9-bd11-39aca4f69434 None None] MFA Rules not processed for user `851997d2ffc74b6397e3d4fb82684049`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:39.676611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d14b6491-f0f7-4ae9-bd11-39aca4f69434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:39.752845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1203/2368] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:48.323593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144748b-e268-40e1-b588-c4796c43495a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:48.324140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144748b-e268-40e1-b588-c4796c43495a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:48.324140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144748b-e268-40e1-b588-c4796c43495a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:48.359240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a144748b-e268-40e1-b588-c4796c43495a None None] MFA Rules not processed for user `f571c879727140d6892208df5408ee74`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:48.360680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a144748b-e268-40e1-b588-c4796c43495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:48.468446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1166/2369] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:48.480159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b6491-f0f7-4ae9-bd11-39aca4f69434 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:48.486105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d14b6491-f0f7-4ae9-bd11-39aca4f69434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:48.576304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b6491-f0f7-4ae9-bd11-39aca4f69434 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:48.580100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00283447a1a6405b952e541a13c91110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:48.580887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:48.581227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:48.581507 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:48.660333 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:48.662704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:48.667624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:48.688335 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1204/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:27:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:27:49.160016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8178ce-3e0a-4115-9440-f2b5e9a6de03 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:49.160637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8178ce-3e0a-4115-9440-f2b5e9a6de03 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:49.161093 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8178ce-3e0a-4115-9440-f2b5e9a6de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:49.189482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5a8178ce-3e0a-4115-9440-f2b5e9a6de03 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:49.194846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5a8178ce-3e0a-4115-9440-f2b5e9a6de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:49.267655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1167/2371] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:27:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:27:49.321556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:27:49.323220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:49.429795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee60a-1d2d-43d8-bb32-c6b6000269bf service glance] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:27:49.437495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6138124-f27e-4121-84fb-62f61ebc344c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:27:49.438312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6138124-f27e-4121-84fb-62f61ebc344c service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:49.438781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6138124-f27e-4121-84fb-62f61ebc344c service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:49.442623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6138124-f27e-4121-84fb-62f61ebc344c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:49.463511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6138124-f27e-4121-84fb-62f61ebc344c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:27:49.466081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6138124-f27e-4121-84fb-62f61ebc344c service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:27:49.482913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1205/2372] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:27:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:27:56.664821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75676126-b8ac-44a5-883d-f69747455cd3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:27:56.665397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75676126-b8ac-44a5-883d-f69747455cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:27:56.665397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75676126-b8ac-44a5-883d-f69747455cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:27:56.689240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-75676126-b8ac-44a5-883d-f69747455cd3 None None] MFA Rules not processed for user `38b014214aeb48218e2223817fc655fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:27:56.690448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-75676126-b8ac-44a5-883d-f69747455cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:27:56.734191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:27:56.745311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1168/2373] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:27:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:27:59.475196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=33 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:01.347245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cefa4-6752-4432-b6c4-d72df4136b52 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:01.347979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cefa4-6752-4432-b6c4-d72df4136b52 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:01.347979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cefa4-6752-4432-b6c4-d72df4136b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:01.370278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-498cefa4-6752-4432-b6c4-d72df4136b52 None None] MFA Rules not processed for user `2bab51b1620049d9ace1e212ed99922f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:01.371519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-498cefa4-6752-4432-b6c4-d72df4136b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:01.378435 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1206/2374] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:06.293691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0824c-6019-41d2-8f9d-59506941dd5e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:06.294253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0824c-6019-41d2-8f9d-59506941dd5e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:06.294253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0824c-6019-41d2-8f9d-59506941dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:06.314027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a9b0824c-6019-41d2-8f9d-59506941dd5e None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:06.315227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a9b0824c-6019-41d2-8f9d-59506941dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:06.323378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1169/2375] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:06.342372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cefa4-6752-4432-b6c4-d72df4136b52 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:06.355584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cefa4-6752-4432-b6c4-d72df4136b52 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:06.360463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d551192-7bef-449b-acdf-3c78da6c06b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:06.361070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d551192-7bef-449b-acdf-3c78da6c06b6 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:06.361346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d551192-7bef-449b-acdf-3c78da6c06b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:06.361616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d551192-7bef-449b-acdf-3c78da6c06b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:06.371194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d551192-7bef-449b-acdf-3c78da6c06b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:06.376060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d551192-7bef-449b-acdf-3c78da6c06b6 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:06.385926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1207/2376] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:28:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:28:16.308998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:16.382028 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=9 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:24.367858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0824c-6019-41d2-8f9d-59506941dd5e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:24.367858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a9b0824c-6019-41d2-8f9d-59506941dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:24.426827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0824c-6019-41d2-8f9d-59506941dd5e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:24.433741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:24.434531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:24.434870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:24.435226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:24.437392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:24.451424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:24.453049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:24.464762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1170/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:28:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:28:27.389610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c5af-193f-4abc-9124-a75fb550793b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:27.390236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c5af-193f-4abc-9124-a75fb550793b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:27.390236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891c5af-193f-4abc-9124-a75fb550793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:27.410739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3891c5af-193f-4abc-9124-a75fb550793b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:27.412178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3891c5af-193f-4abc-9124-a75fb550793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:27.483496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1208/2378] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:27.513573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:27.514979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:27.606553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bc37a-2fbe-48f1-a953-ebe6bac01bf7 service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:27.612029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042674b-35c7-4ce0-a978-023d63f9ec98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:27.612671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042674b-35c7-4ce0-a978-023d63f9ec98 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:27.612946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042674b-35c7-4ce0-a978-023d63f9ec98 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:27.613214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042674b-35c7-4ce0-a978-023d63f9ec98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:27.622584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042674b-35c7-4ce0-a978-023d63f9ec98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:27.624161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042674b-35c7-4ce0-a978-023d63f9ec98 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:27.634446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1171/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:28:34.509263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5897da2-79ed-45dc-9e2b-f9ddcfc87982 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:34.510076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5897da2-79ed-45dc-9e2b-f9ddcfc87982 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:34.510191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5897da2-79ed-45dc-9e2b-f9ddcfc87982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:34.529981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b5897da2-79ed-45dc-9e2b-f9ddcfc87982 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:34.531197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b5897da2-79ed-45dc-9e2b-f9ddcfc87982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:34.539751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1209/2380] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:34.556007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042674b-35c7-4ce0-a978-023d63f9ec98 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:34.567989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042674b-35c7-4ce0-a978-023d63f9ec98 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:34.574014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e508523-bed6-47f3-9620-ee62babbbc0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:34.574615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e508523-bed6-47f3-9620-ee62babbbc0a service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:34.574891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e508523-bed6-47f3-9620-ee62babbbc0a service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:34.575161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e508523-bed6-47f3-9620-ee62babbbc0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:34.583878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e508523-bed6-47f3-9620-ee62babbbc0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:34.585722 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e508523-bed6-47f3-9620-ee62babbbc0a service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:34.595135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1172/2381] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:28:37.358245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2863f-325d-4d29-86f4-286f5efcc9ab None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:37.358699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2863f-325d-4d29-86f4-286f5efcc9ab None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:37.358789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2863f-325d-4d29-86f4-286f5efcc9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:37.378418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-14d2863f-325d-4d29-86f4-286f5efcc9ab None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:37.379627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-14d2863f-325d-4d29-86f4-286f5efcc9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:37.390046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1210/2382] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:37.405556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e508523-bed6-47f3-9620-ee62babbbc0a service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:37.418137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e508523-bed6-47f3-9620-ee62babbbc0a service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:37.424071 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:37.424765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:37.425185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:37.425737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:37.435668 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:37.437704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:37.451164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1173/2383] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:28:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:28:39.374980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a9f8a-fafa-427d-a4c7-2c54f1f7236c None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:39.375570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a9f8a-fafa-427d-a4c7-2c54f1f7236c None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:39.375570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a9f8a-fafa-427d-a4c7-2c54f1f7236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:39.407372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ef5a9f8a-fafa-427d-a4c7-2c54f1f7236c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:39.409368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ef5a9f8a-fafa-427d-a4c7-2c54f1f7236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:39.422735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1211/2384] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:39.446184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:39.447865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:39.492529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f84988-57de-423b-9cf3-d082de4cebf7 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:39.500104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b807ad7-408c-4b6a-baa5-cd02c983ba01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:39.501244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807ad7-408c-4b6a-baa5-cd02c983ba01 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:39.501825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807ad7-408c-4b6a-baa5-cd02c983ba01 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:39.502283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b807ad7-408c-4b6a-baa5-cd02c983ba01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:39.518813 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b807ad7-408c-4b6a-baa5-cd02c983ba01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:39.522172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b807ad7-408c-4b6a-baa5-cd02c983ba01 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:39.552915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1174/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:28:43.309367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4067a3-f0f6-4b91-95b1-60a1675b315e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:43.309914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4067a3-f0f6-4b91-95b1-60a1675b315e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:43.310143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4067a3-f0f6-4b91-95b1-60a1675b315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:43.331411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-aa4067a3-f0f6-4b91-95b1-60a1675b315e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:43.332808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa4067a3-f0f6-4b91-95b1-60a1675b315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:43.341992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1212/2386] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:43.358585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b807ad7-408c-4b6a-baa5-cd02c983ba01 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:43.373614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b807ad7-408c-4b6a-baa5-cd02c983ba01 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:43.385165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf197cf-e44a-416b-9a2c-78877e2bc50c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:43.385165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf197cf-e44a-416b-9a2c-78877e2bc50c service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:43.385165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf197cf-e44a-416b-9a2c-78877e2bc50c service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:43.385165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf197cf-e44a-416b-9a2c-78877e2bc50c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:43.395112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf197cf-e44a-416b-9a2c-78877e2bc50c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:43.398226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf197cf-e44a-416b-9a2c-78877e2bc50c service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:43.413712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1175/2387] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:28:44.354733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4067a3-f0f6-4b91-95b1-60a1675b315e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:44.356826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-aa4067a3-f0f6-4b91-95b1-60a1675b315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:44.456155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4067a3-f0f6-4b91-95b1-60a1675b315e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:44.461245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0abb37-23b7-498e-9804-1fb3762cd417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:44.462229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0abb37-23b7-498e-9804-1fb3762cd417 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:44.462665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0abb37-23b7-498e-9804-1fb3762cd417 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:44.463098 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0abb37-23b7-498e-9804-1fb3762cd417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:44.480187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0abb37-23b7-498e-9804-1fb3762cd417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:44.482265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0abb37-23b7-498e-9804-1fb3762cd417 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:44.494744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1213/2388] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:28:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:28:46.692946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028582b-08a1-47b6-b784-d6996a812a7e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:46.693653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028582b-08a1-47b6-b784-d6996a812a7e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:46.693653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028582b-08a1-47b6-b784-d6996a812a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:46.702172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:46.716984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7028582b-08a1-47b6-b784-d6996a812a7e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:46.718375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7028582b-08a1-47b6-b784-d6996a812a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:46.728528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1176/2389] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:46.751180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0abb37-23b7-498e-9804-1fb3762cd417 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:46.764485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0abb37-23b7-498e-9804-1fb3762cd417 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:46.772861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45dcac-0c7a-470f-9c51-e13304014bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:46.773740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45dcac-0c7a-470f-9c51-e13304014bab service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:46.774207 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45dcac-0c7a-470f-9c51-e13304014bab service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:46.774637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45dcac-0c7a-470f-9c51-e13304014bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:46.784889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45dcac-0c7a-470f-9c51-e13304014bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:46.787573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45dcac-0c7a-470f-9c51-e13304014bab service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:46.799638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1214/2390] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:28:48.196381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455de2-4b47-44e0-8286-d962cc1534bb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:48.198624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455de2-4b47-44e0-8286-d962cc1534bb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:48.198624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455de2-4b47-44e0-8286-d962cc1534bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:48.249025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a2455de2-4b47-44e0-8286-d962cc1534bb None None] MFA Rules not processed for user `e0f0bf68631642c197600f557e999adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:48.250604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a2455de2-4b47-44e0-8286-d962cc1534bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:48.328717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1177/2391] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:28:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:51.157693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218139a-4c50-4ab8-a4f1-9617ecb88b60 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:51.158565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218139a-4c50-4ab8-a4f1-9617ecb88b60 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:51.159005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218139a-4c50-4ab8-a4f1-9617ecb88b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:51.191338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9218139a-4c50-4ab8-a4f1-9617ecb88b60 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:51.194239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9218139a-4c50-4ab8-a4f1-9617ecb88b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:51.205190 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1215/2392] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:51.323828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2455de2-4b47-44e0-8286-d962cc1534bb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:51.338441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2455de2-4b47-44e0-8286-d962cc1534bb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:51.344845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910d81-2580-443b-9cc1-8a8bc1b93035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:51.345833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910d81-2580-443b-9cc1-8a8bc1b93035 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:51.346367 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910d81-2580-443b-9cc1-8a8bc1b93035 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:51.346644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b910d81-2580-443b-9cc1-8a8bc1b93035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:51.356966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b910d81-2580-443b-9cc1-8a8bc1b93035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:51.358866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b910d81-2580-443b-9cc1-8a8bc1b93035 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:51.375947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1178/2393] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:28:58.264560 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d80128-49d7-4913-826d-b032e020bbec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:58.265084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d80128-49d7-4913-826d-b032e020bbec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:58.265183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d80128-49d7-4913-826d-b032e020bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:58.273151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=75 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:28:58.284980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b7d80128-49d7-4913-826d-b032e020bbec None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:28:58.286806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7d80128-49d7-4913-826d-b032e020bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:28:58.293812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1216/2394] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:28:58.306327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910d81-2580-443b-9cc1-8a8bc1b93035 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:28:58.317830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b910d81-2580-443b-9cc1-8a8bc1b93035 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:28:58.322849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6372f-d3e6-44ab-8ff2-401dead0fa68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:28:58.323466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6372f-d3e6-44ab-8ff2-401dead0fa68 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:28:58.323745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6372f-d3e6-44ab-8ff2-401dead0fa68 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:28:58.324013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6372f-d3e6-44ab-8ff2-401dead0fa68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:28:58.331840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6372f-d3e6-44ab-8ff2-401dead0fa68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:28:58.334362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6372f-d3e6-44ab-8ff2-401dead0fa68 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:28:58.342192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1179/2395] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:28:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:29:01.165073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d80128-49d7-4913-826d-b032e020bbec None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:29:01.167291 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7d80128-49d7-4913-826d-b032e020bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:01.182718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d80128-49d7-4913-826d-b032e020bbec None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:29:01.188203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:29:01.188891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:01.189170 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:01.189441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] PATH_INFO: `/v3/users/38b014214aeb48218e2223817fc655fb` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:01.190577 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b014214aeb48218e2223817fc655fb)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:29:01.193148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:29:01.336436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b014214aeb48218e2223817fc655fb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.343173 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b014214aeb48218e2223817fc655fb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.355017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b014214aeb48218e2223817fc655fb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.397389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b014214aeb48218e2223817fc655fb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.398030 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-222bffc6-88a4-450d-a72a-e3705545bd91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b014214aeb48218e2223817fc655fb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.403977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1217/2396] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:29:01 2022] DELETE /identity/v3/users/38b014214aeb48218e2223817fc655fb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:29:01.649615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6372f-d3e6-44ab-8ff2-401dead0fa68 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:29:01.663491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6372f-d3e6-44ab-8ff2-401dead0fa68 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:29:01.721856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:29:01.722481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:01.722754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:01.723024 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] PATH_INFO: `/v3/projects/346409b0b148490f94a7c2faf26eca07` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:01.725006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346409b0b148490f94a7c2faf26eca07)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:29:01.726905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:29:01.866670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346409b0b148490f94a7c2faf26eca07', 'request_id': 'req-57e343fd-90e1-4d71-8601-be170dd24f11'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.938684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346409b0b148490f94a7c2faf26eca07', 'request_id': 'req-57e343fd-90e1-4d71-8601-be170dd24f11'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.945580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346409b0b148490f94a7c2faf26eca07', 'request_id': 'req-57e343fd-90e1-4d71-8601-be170dd24f11'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.956269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] The token cache is being invalidate because project 346409b0b148490f94a7c2faf26eca07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:29:01.956590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.957287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-57e343fd-90e1-4d71-8601-be170dd24f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:29:01.959403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1180/2397] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:29:01 2022] DELETE /identity/v3/projects/346409b0b148490f94a7c2faf26eca07 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:29:06.065878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcec427-e3fe-47bc-adc3-591dceb64b17 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:06.066397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcec427-e3fe-47bc-adc3-591dceb64b17 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:06.066397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcec427-e3fe-47bc-adc3-591dceb64b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:06.085225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-5fcec427-e3fe-47bc-adc3-591dceb64b17 None None] MFA Rules not processed for user `c6c7983040654f15ae92aea3511846de`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:29:06.086410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5fcec427-e3fe-47bc-adc3-591dceb64b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:06.151179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1218/2398] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:29:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:29:11.116664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac701582-d960-46a2-b391-c8b5e0fb5b04 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:11.117169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac701582-d960-46a2-b391-c8b5e0fb5b04 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:11.117251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac701582-d960-46a2-b391-c8b5e0fb5b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:11.125559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:11.138126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ac701582-d960-46a2-b391-c8b5e0fb5b04 None None] MFA Rules not processed for user `851997d2ffc74b6397e3d4fb82684049`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:29:11.139365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ac701582-d960-46a2-b391-c8b5e0fb5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:11.204812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1181/2399] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:29:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:29:16.138623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:21.253222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=23 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:26.429009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecaa32-4b9e-4c96-984e-d153845477f3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:26.429610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecaa32-4b9e-4c96-984e-d153845477f3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:26.429610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecaa32-4b9e-4c96-984e-d153845477f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:26.449315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-50ecaa32-4b9e-4c96-984e-d153845477f3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:29:26.450607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-50ecaa32-4b9e-4c96-984e-d153845477f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:26.511843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1219/2400] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:29:26.527765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac701582-d960-46a2-b391-c8b5e0fb5b04 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:29:26.529243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ac701582-d960-46a2-b391-c8b5e0fb5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:26.611483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac701582-d960-46a2-b391-c8b5e0fb5b04 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:29:26.617808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:29:26.618410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:26.618687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:26.618954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:26.626919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:29:26.628516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:29:26.638420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1182/2401] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:29:30.918639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f769e-0b14-4884-b7b0-1f52163a9dae None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:30.919136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f769e-0b14-4884-b7b0-1f52163a9dae None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:30.919251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f769e-0b14-4884-b7b0-1f52163a9dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:30.938898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-313f769e-0b14-4884-b7b0-1f52163a9dae None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:29:30.940086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-313f769e-0b14-4884-b7b0-1f52163a9dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:30.948094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1220/2402] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:29:30.961529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:29:30.962992 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:30.977895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a29e27-b0ff-4e27-a109-ee28f4422f9f service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:29:30.983362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0de49-65a6-4bea-b6be-2bce32d0fe79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:29:30.983955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0de49-65a6-4bea-b6be-2bce32d0fe79 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:30.984232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0de49-65a6-4bea-b6be-2bce32d0fe79 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:30.984530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0de49-65a6-4bea-b6be-2bce32d0fe79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:30.993163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0de49-65a6-4bea-b6be-2bce32d0fe79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:29:30.994730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0de49-65a6-4bea-b6be-2bce32d0fe79 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:29:31.004002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1183/2403] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:29:33.758499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023435c5-b09a-43e1-aeab-06f020c43fc9 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:33.758979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023435c5-b09a-43e1-aeab-06f020c43fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:33.759074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023435c5-b09a-43e1-aeab-06f020c43fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:33.778268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-023435c5-b09a-43e1-aeab-06f020c43fc9 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:29:33.779585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-023435c5-b09a-43e1-aeab-06f020c43fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:33.793512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1221/2404] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:29:33.809427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0de49-65a6-4bea-b6be-2bce32d0fe79 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:29:33.825041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0de49-65a6-4bea-b6be-2bce32d0fe79 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:29:33.826649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933c24-c414-4af5-8aba-4e897196aa4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:29:33.827301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933c24-c414-4af5-8aba-4e897196aa4e service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:33.827577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933c24-c414-4af5-8aba-4e897196aa4e service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:33.827842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3933c24-c414-4af5-8aba-4e897196aa4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:33.837308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3933c24-c414-4af5-8aba-4e897196aa4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:29:33.838642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3933c24-c414-4af5-8aba-4e897196aa4e service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:29:33.848335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1184/2405] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:29:37.053303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687642b-5609-4ce5-b067-e4c48fae9921 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:37.053832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687642b-5609-4ce5-b067-e4c48fae9921 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:37.053832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687642b-5609-4ce5-b067-e4c48fae9921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:37.074147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f687642b-5609-4ce5-b067-e4c48fae9921 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:29:37.075321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f687642b-5609-4ce5-b067-e4c48fae9921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:37.083229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1222/2406] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:29:37.098484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933c24-c414-4af5-8aba-4e897196aa4e service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:29:37.110240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3933c24-c414-4af5-8aba-4e897196aa4e service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:29:37.115552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85abb-166d-4b17-ad84-27c9f622fbb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:29:37.116143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85abb-166d-4b17-ad84-27c9f622fbb4 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:37.116455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85abb-166d-4b17-ad84-27c9f622fbb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:37.116856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e85abb-166d-4b17-ad84-27c9f622fbb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:37.124763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85abb-166d-4b17-ad84-27c9f622fbb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:29:37.126400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e85abb-166d-4b17-ad84-27c9f622fbb4 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:29:37.135985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1185/2407] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:29:40.252075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194b1b-1430-4d82-b6ab-c1324b1076ba None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:40.252579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194b1b-1430-4d82-b6ab-c1324b1076ba None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:40.252672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194b1b-1430-4d82-b6ab-c1324b1076ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:40.272656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-64194b1b-1430-4d82-b6ab-c1324b1076ba None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:29:40.274511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-64194b1b-1430-4d82-b6ab-c1324b1076ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:40.282502 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1223/2408] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Aug 28 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:29:40.298776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85abb-166d-4b17-ad84-27c9f622fbb4 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:29:40.309863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e85abb-166d-4b17-ad84-27c9f622fbb4 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:29:40.315227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:29:40.315820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:40.316092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:40.316393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:40.324361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:29:40.325924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:29:40.335004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1186/2409] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:29:50.267873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=39 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:50.330961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=58 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:29:52.891689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9c4d6-d896-497e-af2a-dfcc2bb5f0c7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:29:52.892208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9c4d6-d896-497e-af2a-dfcc2bb5f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:29:52.892208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9c4d6-d896-497e-af2a-dfcc2bb5f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:29:52.911873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4ec9c4d6-d896-497e-af2a-dfcc2bb5f0c7 None None] MFA Rules not processed for user `9e755fa1e0ec4820a476b9807dfc3d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:29:52.913279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4ec9c4d6-d896-497e-af2a-dfcc2bb5f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:29:52.968948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1224/2410] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:29:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:30:02.961611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=25 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:15.566321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:15.568310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:15.582846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662acc86-3d39-4c06-8bc4-59a7acaeb9a8 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:15.593426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:15.594211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:15.594480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:15.594694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] PATH_INFO: `/v3/users/851997d2ffc74b6397e3d4fb82684049` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:15.595840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851997d2ffc74b6397e3d4fb82684049)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:15.598082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:15.852633 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851997d2ffc74b6397e3d4fb82684049'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:15.861405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851997d2ffc74b6397e3d4fb82684049'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:15.934530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851997d2ffc74b6397e3d4fb82684049'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:15.948705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851997d2ffc74b6397e3d4fb82684049'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:15.949488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d7521798-19f1-42a9-8cf8-fe26516118e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851997d2ffc74b6397e3d4fb82684049'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:15.956635 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1187/2411] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:30:15 2022] DELETE /identity/v3/users/851997d2ffc74b6397e3d4fb82684049 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:16.307838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9c4d6-d896-497e-af2a-dfcc2bb5f0c7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:16.320933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9c4d6-d896-497e-af2a-dfcc2bb5f0c7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:16.388977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:16.389743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:16.390025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:16.390301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] PATH_INFO: `/v3/projects/80a873712c224e929d7f03d0d9a14bdc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:16.391552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a873712c224e929d7f03d0d9a14bdc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:16.393548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:16.521763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a873712c224e929d7f03d0d9a14bdc', 'request_id': 'req-226db9eb-b201-46de-aef4-cf41cace10da'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:16.528373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a873712c224e929d7f03d0d9a14bdc', 'request_id': 'req-226db9eb-b201-46de-aef4-cf41cace10da'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:16.535354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a873712c224e929d7f03d0d9a14bdc', 'request_id': 'req-226db9eb-b201-46de-aef4-cf41cace10da'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:16.557125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390381-6f1a-422f-bf5b-659d2bf58557 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:16.557503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390381-6f1a-422f-bf5b-659d2bf58557 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:16.557787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390381-6f1a-422f-bf5b-659d2bf58557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:16.578433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b5390381-6f1a-422f-bf5b-659d2bf58557 None None] MFA Rules not processed for user `e0f0bf68631642c197600f557e999adc`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:30:16.579702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b5390381-6f1a-422f-bf5b-659d2bf58557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:16.638929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] The token cache is being invalidate because project 80a873712c224e929d7f03d0d9a14bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:30:16.639253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:16.639631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1188/2412] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:30:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:30:16.644468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:16.646047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1225/2413] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:30:16 2022] DELETE /identity/v3/projects/80a873712c224e929d7f03d0d9a14bdc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:18.816916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5390381-6f1a-422f-bf5b-659d2bf58557 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:18.818378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b5390381-6f1a-422f-bf5b-659d2bf58557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:18.907039 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5390381-6f1a-422f-bf5b-659d2bf58557 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:18.910894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:18.911501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:18.911781 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:18.916410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:18.916410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:18.957914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:19.000569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:19.002119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:19.014615 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1189/2414] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:19.991697 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:19.993188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:20.007478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226db9eb-b201-46de-aef4-cf41cace10da admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:20.011709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:20.012351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:20.012633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:20.012948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:20.017609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:20.095672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:20.097305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:20.108682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1226/2415] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:21.259599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:21.269561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190709f-a71a-473d-a26f-3904f52be247 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:21.275223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:21.276120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:21.276430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:21.276704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:21.278455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:21.293749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:21.295876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:21.309855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1190/2416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:24.299464 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:24.301192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:24.314381 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec7598-d0ba-420d-9521-401f734a68da service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:24.318972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:24.319593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:24.319871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:24.320145 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] PATH_INFO: `/v3/users/c6c7983040654f15ae92aea3511846de` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:24.321326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c7983040654f15ae92aea3511846de)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:24.323220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:24.344806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:24.514252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c7983040654f15ae92aea3511846de'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:24.521341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c7983040654f15ae92aea3511846de'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:24.532765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c7983040654f15ae92aea3511846de'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:24.636017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c7983040654f15ae92aea3511846de'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:24.636673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-21f0c670-0a59-4a30-ad71-d43b0a701929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c7983040654f15ae92aea3511846de'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:24.643150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1227/2417] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:30:24 2022] DELETE /identity/v3/users/c6c7983040654f15ae92aea3511846de => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:24.879666 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:24.898165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df092d-3b62-4b99-9db2-1e36f9c3678f service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:24.960614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:24.961303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:24.961584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:24.961857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] PATH_INFO: `/v3/projects/3d842fc8902a470fbdd71a797552b51f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:24.962991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d842fc8902a470fbdd71a797552b51f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:24.964956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:25.108601 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d842fc8902a470fbdd71a797552b51f', 'request_id': 'req-fa65fa66-b587-4119-b06d-fc14897150e9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:25.174624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d842fc8902a470fbdd71a797552b51f', 'request_id': 'req-fa65fa66-b587-4119-b06d-fc14897150e9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:25.181758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d842fc8902a470fbdd71a797552b51f', 'request_id': 'req-fa65fa66-b587-4119-b06d-fc14897150e9'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:25.192482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] The token cache is being invalidate because project 3d842fc8902a470fbdd71a797552b51f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:30:25.192775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:25.193423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-fa65fa66-b587-4119-b06d-fc14897150e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:25.194880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1191/2418] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:30:24 2022] DELETE /identity/v3/projects/3d842fc8902a470fbdd71a797552b51f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:25.199851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398200-fb7d-4607-b5ee-5aa03436b577 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.200135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398200-fb7d-4607-b5ee-5aa03436b577 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.201085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53398200-fb7d-4607-b5ee-5aa03436b577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.222771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-53398200-fb7d-4607-b5ee-5aa03436b577 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:30:25.224019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-53398200-fb7d-4607-b5ee-5aa03436b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:25.286216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1228/2419] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:30:25.293996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57388e-aa9a-4f14-bf93-6d24d87a38a6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.294308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57388e-aa9a-4f14-bf93-6d24d87a38a6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.294834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57388e-aa9a-4f14-bf93-6d24d87a38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.317525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5d57388e-aa9a-4f14-bf93-6d24d87a38a6 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:30:25.318728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5d57388e-aa9a-4f14-bf93-6d24d87a38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:25.330535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1192/2420] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:30:25.334977 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398200-fb7d-4607-b5ee-5aa03436b577 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:25.345707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53398200-fb7d-4607-b5ee-5aa03436b577 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:25.349986 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:25.350584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.350857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.351124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.351797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:30:25.352393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:25.353703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:25.366818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1229/2421] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:30:25.371103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57388e-aa9a-4f14-bf93-6d24d87a38a6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:25.381258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57388e-aa9a-4f14-bf93-6d24d87a38a6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:25.386433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc40c2-bec4-4b4a-b8fb-6418a48051f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:25.387028 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc40c2-bec4-4b4a-b8fb-6418a48051f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.387303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc40c2-bec4-4b4a-b8fb-6418a48051f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.387573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc40c2-bec4-4b4a-b8fb-6418a48051f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.389207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc40c2-bec4-4b4a-b8fb-6418a48051f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:25.391150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc40c2-bec4-4b4a-b8fb-6418a48051f5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:25.488143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1193/2422] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:30:25 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:30:25.492161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:25.502921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8c37c-235f-4a20-9c9d-a47e11f08108 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:25.557883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90568-12df-4112-8833-4ef5c74ba1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:25.558480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90568-12df-4112-8833-4ef5c74ba1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.558759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90568-12df-4112-8833-4ef5c74ba1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.559027 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90568-12df-4112-8833-4ef5c74ba1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.560194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90568-12df-4112-8833-4ef5c74ba1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:25.562399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90568-12df-4112-8833-4ef5c74ba1d9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:25.673011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1230/2423] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:30:25 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:30:25.677667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc40c2-bec4-4b4a-b8fb-6418a48051f5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:25.689600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc40c2-bec4-4b4a-b8fb-6418a48051f5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:25.694512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcdcbb-ff6c-404a-b65b-c6b8d49c9ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:25.695486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcdcbb-ff6c-404a-b65b-c6b8d49c9ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.695780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcdcbb-ff6c-404a-b65b-c6b8d49c9ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.696050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcdcbb-ff6c-404a-b65b-c6b8d49c9ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.696736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcdcbb-ff6c-404a-b65b-c6b8d49c9ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:25.698377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcdcbb-ff6c-404a-b65b-c6b8d49c9ba0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:25.699774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:25.709828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1194/2424] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:30:25.713874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90568-12df-4112-8833-4ef5c74ba1d9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:25.723894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90568-12df-4112-8833-4ef5c74ba1d9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:25.728585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcfd7f-4ba5-482a-a6d9-7ecbd462944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:25.729202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcfd7f-4ba5-482a-a6d9-7ecbd462944c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.729465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcfd7f-4ba5-482a-a6d9-7ecbd462944c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.729737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcfd7f-4ba5-482a-a6d9-7ecbd462944c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.730385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcfd7f-4ba5-482a-a6d9-7ecbd462944c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:25.732724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcfd7f-4ba5-482a-a6d9-7ecbd462944c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:25.743264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1231/2425] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:30:25.747986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcdcbb-ff6c-404a-b65b-c6b8d49c9ba0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:25.758172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcdcbb-ff6c-404a-b65b-c6b8d49c9ba0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:25.763656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:25.764310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.764590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.764862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] PATH_INFO: `/v3/projects/10b6c71a479a4521ae3286b3b7432513/users/ab42e078660a4b5d878aeec160c33123/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.779625 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b6c71a479a4521ae3286b3b7432513, user_id=ab42e078660a4b5d878aeec160c33123, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:25.782410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:25.847609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1195/2426] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:30:25 2022] PUT /identity/v3/projects/10b6c71a479a4521ae3286b3b7432513/users/ab42e078660a4b5d878aeec160c33123/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:25.858369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21913a7d-960d-405c-88a2-1d8e6ca95d9b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:25.858732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21913a7d-960d-405c-88a2-1d8e6ca95d9b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:25.858958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21913a7d-960d-405c-88a2-1d8e6ca95d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:25.866534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:25.879308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-21913a7d-960d-405c-88a2-1d8e6ca95d9b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:30:25.880623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-21913a7d-960d-405c-88a2-1d8e6ca95d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:25.939718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1232/2427] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:30:25.949837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:25.951685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:26.008516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf49419-76cb-401f-906c-abaaadd4ee52 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:26.012453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:26.013245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:26.013684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:26.013960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:26.022838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:26.024270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:26.033610 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1196/2428] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:34.154269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664dce8-71ba-438c-97ad-7420e63826dd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:34.156978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664dce8-71ba-438c-97ad-7420e63826dd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:34.157274 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664dce8-71ba-438c-97ad-7420e63826dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:34.190831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b664dce8-71ba-438c-97ad-7420e63826dd None None] MFA Rules not processed for user `ab42e078660a4b5d878aeec160c33123`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:30:34.192628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b664dce8-71ba-438c-97ad-7420e63826dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:34.302699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1233/2429] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:30:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:30:34.318826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:34.320365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:34.430413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d2181-1fcf-42a9-b653-7b2d64caa3b4 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:34.438111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:34.438819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:34.439195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:34.439578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:34.451630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:34.461461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:34.464728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1197/2430] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:37.118129 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc1e-b379-4b0d-be1d-cd0805199ae3 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:37.119901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc1e-b379-4b0d-be1d-cd0805199ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:37.120678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc1e-b379-4b0d-be1d-cd0805199ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:37.147055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f4acdc1e-b379-4b0d-be1d-cd0805199ae3 None None] MFA Rules not processed for user `ab42e078660a4b5d878aeec160c33123`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:30:37.149023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f4acdc1e-b379-4b0d-be1d-cd0805199ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:37.157566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1234/2431] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:30:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:30:37.579412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:37.581416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:37.595260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1c2c3-8eca-49ee-84a3-13d723fbdfc5 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:37.601820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c2b79-e295-441a-83e5-b228364d479f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:37.601820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c2b79-e295-441a-83e5-b228364d479f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:37.601820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c2b79-e295-441a-83e5-b228364d479f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:37.601820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c2b79-e295-441a-83e5-b228364d479f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:37.602619 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ef3c2b79-e295-441a-83e5-b228364d479f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:37.615170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c2b79-e295-441a-83e5-b228364d479f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:37.617148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c2b79-e295-441a-83e5-b228364d479f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:37.626406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1198/2432] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:38.149836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acdc1e-b379-4b0d-be1d-cd0805199ae3 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:38.155563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f4acdc1e-b379-4b0d-be1d-cd0805199ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:38.269429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acdc1e-b379-4b0d-be1d-cd0805199ae3 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:38.275294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:38.275905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:38.276227 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:38.276527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:38.278902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:38.291492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:38.293366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:38.308720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1235/2433] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:39.444003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd09e-7e1e-4448-98c7-da547c819386 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:39.444493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd09e-7e1e-4448-98c7-da547c819386 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:39.444634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd09e-7e1e-4448-98c7-da547c819386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:39.466326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-8a6cd09e-7e1e-4448-98c7-da547c819386 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:30:39.468431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8a6cd09e-7e1e-4448-98c7-da547c819386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:39.514685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:39.529287 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1199/2434] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 10:30:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:30:39.685045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:39.687304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:39.713026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:39.777542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ac1c-c260-41d9-ab4c-77ad8de90dff service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:39.784285 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:39.785297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:39.785786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:39.786055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:39.799059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:39.799059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:39.805514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1236/2435] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:30:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:30:43.965521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd09e-7e1e-4448-98c7-da547c819386 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:43.976435 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd09e-7e1e-4448-98c7-da547c819386 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:43.985609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:43.986476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:43.986915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:43.987342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:43.989357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:44.002356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:44.003892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:44.015047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1200/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:49.242553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:49.245058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:49.260511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbef75b-57d0-43b0-ad2d-1e68c7f9dc30 service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:49.265249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:49.266183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:49.266183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:49.266367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] PATH_INFO: `/v3/users/2bab51b1620049d9ace1e212ed99922f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:49.267490 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bab51b1620049d9ace1e212ed99922f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:49.269505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:49.380153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:49.402518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa848fc-7aa6-4342-b48c-bcb83e116e18 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:49.412479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:49.412479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:49.412479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:49.412479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:49.414571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:49.480060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:49.481926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:49.483081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bab51b1620049d9ace1e212ed99922f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:49.493063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1201/2437] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:30:49.494380 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bab51b1620049d9ace1e212ed99922f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:49.510698 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bab51b1620049d9ace1e212ed99922f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:49.619461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bab51b1620049d9ace1e212ed99922f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:49.633652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bab51b1620049d9ace1e212ed99922f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:49.633652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1237/2438] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:30:49 2022] DELETE /identity/v3/users/2bab51b1620049d9ace1e212ed99922f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:49.916828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:49.927789 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff16f2-f9e0-47df-ac07-07d9ee4557a7 service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:49.987850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:49.988523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:49.988800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:49.989073 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] PATH_INFO: `/v3/projects/c9bed88c30a548ee8a1a101891dd6837` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:49.990269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bed88c30a548ee8a1a101891dd6837)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:49.992198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:50.130345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bed88c30a548ee8a1a101891dd6837', 'request_id': 'req-5e676d51-2362-4bf3-a5bd-cc78d2240aff'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.191717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bed88c30a548ee8a1a101891dd6837', 'request_id': 'req-5e676d51-2362-4bf3-a5bd-cc78d2240aff'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.199306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bed88c30a548ee8a1a101891dd6837', 'request_id': 'req-5e676d51-2362-4bf3-a5bd-cc78d2240aff'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.211282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] The token cache is being invalidate because project c9bed88c30a548ee8a1a101891dd6837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:30:50.211577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.212240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.213945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1202/2439] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:30:49 2022] DELETE /identity/v3/projects/c9bed88c30a548ee8a1a101891dd6837 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:50.219532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:50.219532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:50.232350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5d978-ac3a-4cb4-bdbf-b1509871cb92 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:50.290222 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:50.290906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:50.291112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:50.291382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] PATH_INFO: `/v3/users/f571c879727140d6892208df5408ee74` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:50.292550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f571c879727140d6892208df5408ee74)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:50.294471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:50.316071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:50.445142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f571c879727140d6892208df5408ee74'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.453486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f571c879727140d6892208df5408ee74'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.465252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f571c879727140d6892208df5408ee74'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.551946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f571c879727140d6892208df5408ee74'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.553224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f571c879727140d6892208df5408ee74'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:50.561791 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1238/2440] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:30:50 2022] DELETE /identity/v3/users/f571c879727140d6892208df5408ee74 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:50.854318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:50.855816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:50.872119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e676d51-2362-4bf3-a5bd-cc78d2240aff admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:50.877725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:30:50.934260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:50.934886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:50.935163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:50.935931 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] PATH_INFO: `/v3/projects/a19666692db64e959200ec5c5d65a3dc` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:50.937105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19666692db64e959200ec5c5d65a3dc)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:50.939015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:51.037713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19666692db64e959200ec5c5d65a3dc', 'request_id': 'req-88879444-2225-4a90-bccd-b92514f63b1f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:51.106107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19666692db64e959200ec5c5d65a3dc', 'request_id': 'req-88879444-2225-4a90-bccd-b92514f63b1f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:51.112533 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19666692db64e959200ec5c5d65a3dc', 'request_id': 'req-88879444-2225-4a90-bccd-b92514f63b1f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:51.123994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] The token cache is being invalidate because project a19666692db64e959200ec5c5d65a3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:30:51.124340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:51.124991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:30:51.126504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1203/2441] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:30:50 2022] DELETE /identity/v3/projects/a19666692db64e959200ec5c5d65a3dc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:30:53.290263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:30:53.292002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:53.368802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a12ab-fd55-4a42-9f6a-1570ca90b511 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:30:53.432644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:30:53.433263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:30:53.433547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:30:53.433820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:30:53.436084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:30:53.448558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:30:53.450402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:30:53.464871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1239/2442] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:30:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:01.601084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:03.458620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=8,keystone:SELECT=82,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:05.454236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:05.455283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:05.472279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88879444-2225-4a90-bccd-b92514f63b1f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:05.478000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:05.478671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:05.478959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:05.480477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:05.481136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:05.493943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:05.495636 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:05.519043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1204/2443] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:07.997307 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:08.010167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c10d4-329a-461f-b734-4b694e61e569 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:08.016699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:08.017298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:08.017576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:08.017846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:08.019571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:08.086164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:08.087890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:08.102349 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1240/2444] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:12.091902 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:12.093831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:12.149617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793569c8-ca61-4f92-8543-2753c5528acb service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:12.153218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:12.153823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:12.154103 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:12.154378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:12.156740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:12.218456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:12.219962 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:12.229554 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1205/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:15.973849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:15.975310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:15.989379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1058e-b3c1-40dd-a6cf-a9b0d625e62b service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:15.993950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:15.994573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:15.999245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:15.999245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] PATH_INFO: `/v3/users/9e755fa1e0ec4820a476b9807dfc3d53` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:15.999245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e755fa1e0ec4820a476b9807dfc3d53)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:15.999245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:16.149405 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e755fa1e0ec4820a476b9807dfc3d53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.157163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e755fa1e0ec4820a476b9807dfc3d53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.169300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e755fa1e0ec4820a476b9807dfc3d53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.235186 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e755fa1e0ec4820a476b9807dfc3d53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.235837 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a9d69b0b-0f85-4f98-be6f-7bc36bf8f006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e755fa1e0ec4820a476b9807dfc3d53'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.242693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1241/2446] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:15 2022] DELETE /identity/v3/users/9e755fa1e0ec4820a476b9807dfc3d53 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:16.467607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:16.478824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e598b30-096a-4d89-bda1-ecf0a73598b4 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:16.543289 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:16.544905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:16.545430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:16.545991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] PATH_INFO: `/v3/projects/431175fca4524b01a09f7d58fbbd8ca6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:16.548052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431175fca4524b01a09f7d58fbbd8ca6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:16.552347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:16.797559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:16.804319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431175fca4524b01a09f7d58fbbd8ca6', 'request_id': 'req-9b052966-49ec-4c8e-a37b-da3408c793c2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.892339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431175fca4524b01a09f7d58fbbd8ca6', 'request_id': 'req-9b052966-49ec-4c8e-a37b-da3408c793c2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.899415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431175fca4524b01a09f7d58fbbd8ca6', 'request_id': 'req-9b052966-49ec-4c8e-a37b-da3408c793c2'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.909855 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] The token cache is being invalidate because project 431175fca4524b01a09f7d58fbbd8ca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:16.910150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.910835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9b052966-49ec-4c8e-a37b-da3408c793c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:16.912343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1206/2447] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:16 2022] DELETE /identity/v3/projects/431175fca4524b01a09f7d58fbbd8ca6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:16.917294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32beb71-8859-4cfd-ab1c-d8387d1183a7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:16.917583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32beb71-8859-4cfd-ab1c-d8387d1183a7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:16.917872 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32beb71-8859-4cfd-ab1c-d8387d1183a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:16.938744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-c32beb71-8859-4cfd-ab1c-d8387d1183a7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:16.939968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-c32beb71-8859-4cfd-ab1c-d8387d1183a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:17.009673 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1242/2448] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:31:17.017841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859701ea-31b1-4d38-b1b3-c9e33746d1a7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.018123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859701ea-31b1-4d38-b1b3-c9e33746d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.018394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859701ea-31b1-4d38-b1b3-c9e33746d1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.039139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-859701ea-31b1-4d38-b1b3-c9e33746d1a7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:17.040378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-859701ea-31b1-4d38-b1b3-c9e33746d1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:17.051909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1207/2449] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:17.054494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32beb71-8859-4cfd-ab1c-d8387d1183a7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:17.069810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32beb71-8859-4cfd-ab1c-d8387d1183a7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:17.069810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:17.069810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.070131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.070234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.070838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:31:17.071142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:17.072773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:17.080512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:17.085742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1243/2450] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:31:17.090231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859701ea-31b1-4d38-b1b3-c9e33746d1a7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:17.101373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859701ea-31b1-4d38-b1b3-c9e33746d1a7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:17.114268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494949-a797-47c1-bccd-a12b89a2375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:17.114940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494949-a797-47c1-bccd-a12b89a2375c admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.115238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494949-a797-47c1-bccd-a12b89a2375c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.115513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68494949-a797-47c1-bccd-a12b89a2375c admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.116176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68494949-a797-47c1-bccd-a12b89a2375c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:17.118154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68494949-a797-47c1-bccd-a12b89a2375c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:17.266819 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1208/2451] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:17 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:17.267021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:17.279765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833666c6-ab8a-4765-b5c1-7e5f487f29c9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:17.361311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba0d31-7d75-4c11-869e-eee7950e3447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:17.362556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba0d31-7d75-4c11-869e-eee7950e3447 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.362840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba0d31-7d75-4c11-869e-eee7950e3447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.363200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba0d31-7d75-4c11-869e-eee7950e3447 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.363837 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba0d31-7d75-4c11-869e-eee7950e3447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:17.366255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba0d31-7d75-4c11-869e-eee7950e3447 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:17.464231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1244/2452] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:17 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:17.468858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494949-a797-47c1-bccd-a12b89a2375c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:17.480027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68494949-a797-47c1-bccd-a12b89a2375c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:17.485740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacce24-be76-4fec-8e64-6e7cbd4f297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:17.486473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacce24-be76-4fec-8e64-6e7cbd4f297a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.486750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacce24-be76-4fec-8e64-6e7cbd4f297a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.487195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacce24-be76-4fec-8e64-6e7cbd4f297a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.487861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacce24-be76-4fec-8e64-6e7cbd4f297a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:17.491562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacce24-be76-4fec-8e64-6e7cbd4f297a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:17.501208 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1209/2453] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:17.505359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba0d31-7d75-4c11-869e-eee7950e3447 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:17.516667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba0d31-7d75-4c11-869e-eee7950e3447 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:17.521354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7d69-66b0-4347-aee9-c111cc97a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:17.521994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7d69-66b0-4347-aee9-c111cc97a602 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.522271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7d69-66b0-4347-aee9-c111cc97a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.522545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7d69-66b0-4347-aee9-c111cc97a602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.523192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7d69-66b0-4347-aee9-c111cc97a602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:17.524831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7d69-66b0-4347-aee9-c111cc97a602 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:17.536808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1245/2454] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:17.540835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacce24-be76-4fec-8e64-6e7cbd4f297a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:17.551762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacce24-be76-4fec-8e64-6e7cbd4f297a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:17.557319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cfc67-47e3-489c-8076-f7d37c2f9af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:17.558081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cfc67-47e3-489c-8076-f7d37c2f9af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.558430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cfc67-47e3-489c-8076-f7d37c2f9af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.558771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cfc67-47e3-489c-8076-f7d37c2f9af7 admin admin] PATH_INFO: `/v3/projects/641f0baf7d5b4c56a75eed39e11103b9/users/c86b3f2b8a3645749fc78c3aaf02c228/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.576225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cfc67-47e3-489c-8076-f7d37c2f9af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641f0baf7d5b4c56a75eed39e11103b9, user_id=c86b3f2b8a3645749fc78c3aaf02c228, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:17.580090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cfc67-47e3-489c-8076-f7d37c2f9af7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:17.714216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1210/2455] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:17 2022] PUT /identity/v3/projects/641f0baf7d5b4c56a75eed39e11103b9/users/c86b3f2b8a3645749fc78c3aaf02c228/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:17.715751 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93011-822f-411e-af4c-c8e97801f162 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.716117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93011-822f-411e-af4c-c8e97801f162 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.716457 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb93011-822f-411e-af4c-c8e97801f162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.747123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8fb93011-822f-411e-af4c-c8e97801f162 None None] MFA Rules not processed for user `c86b3f2b8a3645749fc78c3aaf02c228`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:17.748407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8fb93011-822f-411e-af4c-c8e97801f162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:17.817350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1246/2456] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:31:17.821733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cfc67-47e3-489c-8076-f7d37c2f9af7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:17.896463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cfc67-47e3-489c-8076-f7d37c2f9af7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:17.901592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4830a-a14d-47ff-82b7-ae3230ec0199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:17.902207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4830a-a14d-47ff-82b7-ae3230ec0199 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:17.902489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4830a-a14d-47ff-82b7-ae3230ec0199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:17.902770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4830a-a14d-47ff-82b7-ae3230ec0199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:17.903417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4830a-a14d-47ff-82b7-ae3230ec0199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:17.905692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4830a-a14d-47ff-82b7-ae3230ec0199 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:17.997268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1211/2457] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:17 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:18.001993 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93011-822f-411e-af4c-c8e97801f162 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:18.015036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb93011-822f-411e-af4c-c8e97801f162 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:18.091420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45805f6-1a4d-4720-ad78-a48216067e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:18.092040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45805f6-1a4d-4720-ad78-a48216067e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:18.092354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45805f6-1a4d-4720-ad78-a48216067e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:18.093141 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45805f6-1a4d-4720-ad78-a48216067e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:18.094034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45805f6-1a4d-4720-ad78-a48216067e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:18.096595 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45805f6-1a4d-4720-ad78-a48216067e98 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:18.110234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:18.190579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1247/2458] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:18 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:18.194685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4830a-a14d-47ff-82b7-ae3230ec0199 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:18.212477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4830a-a14d-47ff-82b7-ae3230ec0199 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:18.212477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425f0b-dcfc-4ab6-889c-07381a06093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:18.212477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425f0b-dcfc-4ab6-889c-07381a06093e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:18.212906 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425f0b-dcfc-4ab6-889c-07381a06093e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:18.213408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425f0b-dcfc-4ab6-889c-07381a06093e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:18.214167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d425f0b-dcfc-4ab6-889c-07381a06093e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:18.215848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d425f0b-dcfc-4ab6-889c-07381a06093e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:18.227783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1212/2459] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:18.232178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45805f6-1a4d-4720-ad78-a48216067e98 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:18.242667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45805f6-1a4d-4720-ad78-a48216067e98 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:18.247790 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f63929-a915-48a9-a155-8889d192a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:18.248494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63929-a915-48a9-a155-8889d192a8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:18.248818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63929-a915-48a9-a155-8889d192a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:18.254133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63929-a915-48a9-a155-8889d192a8a8 admin admin] PATH_INFO: `/v3/projects/6b49d77718a14b7a8846b2edda3bb251/users/8fb1119ea79d4164be974877b05cb0ca/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:18.266070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f63929-a915-48a9-a155-8889d192a8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b49d77718a14b7a8846b2edda3bb251, user_id=8fb1119ea79d4164be974877b05cb0ca, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:18.268755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f63929-a915-48a9-a155-8889d192a8a8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:18.364989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1248/2460] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:18 2022] PUT /identity/v3/projects/6b49d77718a14b7a8846b2edda3bb251/users/8fb1119ea79d4164be974877b05cb0ca/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:18.369164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425f0b-dcfc-4ab6-889c-07381a06093e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:18.379922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425f0b-dcfc-4ab6-889c-07381a06093e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:18.415844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:18.438894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72253f-b280-44e9-aebc-e748f448b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:18.439505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72253f-b280-44e9-aebc-e748f448b92d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:18.439808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72253f-b280-44e9-aebc-e748f448b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:18.440065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72253f-b280-44e9-aebc-e748f448b92d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:18.440754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72253f-b280-44e9-aebc-e748f448b92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:18.442426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72253f-b280-44e9-aebc-e748f448b92d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:18.452732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1213/2461] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:18.456873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f63929-a915-48a9-a155-8889d192a8a8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:18.467046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f63929-a915-48a9-a155-8889d192a8a8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:18.472354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:18.473108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:18.473389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:18.473662 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] PATH_INFO: `/v3/projects/6b49d77718a14b7a8846b2edda3bb251/users/8fb1119ea79d4164be974877b05cb0ca/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:18.475569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b49d77718a14b7a8846b2edda3bb251, user_id=8fb1119ea79d4164be974877b05cb0ca, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:18.478261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:18.488952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1249/2462] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:18 2022] PUT /identity/v3/projects/6b49d77718a14b7a8846b2edda3bb251/users/8fb1119ea79d4164be974877b05cb0ca/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:18.500412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae3a5-e6c5-4b3d-8464-261a48231867 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:18.500948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae3a5-e6c5-4b3d-8464-261a48231867 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:18.500948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bae3a5-e6c5-4b3d-8464-261a48231867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:18.531614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-83bae3a5-e6c5-4b3d-8464-261a48231867 None None] MFA Rules not processed for user `8fb1119ea79d4164be974877b05cb0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:18.532853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-83bae3a5-e6c5-4b3d-8464-261a48231867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:18.601949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1214/2463] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:18.613712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:18.618369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:18.674311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cd70f-47f1-4d41-832f-d0b81d56b869 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:18.677873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:18.678470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:18.678745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:18.679014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:18.688650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:18.690071 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:18.699363 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1250/2464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:18.871549 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bae3a5-e6c5-4b3d-8464-261a48231867 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:18.882245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bae3a5-e6c5-4b3d-8464-261a48231867 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:18.886009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375d14d-e833-41b5-8b8d-303b3dbfba5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:18.886604 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375d14d-e833-41b5-8b8d-303b3dbfba5a service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:18.886875 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375d14d-e833-41b5-8b8d-303b3dbfba5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:18.887144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375d14d-e833-41b5-8b8d-303b3dbfba5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:18.942801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375d14d-e833-41b5-8b8d-303b3dbfba5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:18.944229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375d14d-e833-41b5-8b8d-303b3dbfba5a service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:18.952936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1215/2465] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:24.360749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:24.362193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:24.418015 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1e4cc-5725-425a-b236-8ee346d17bd6 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:24.421682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676d64f-36b6-4c69-a212-01121ae49565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:24.422366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d64f-36b6-4c69-a212-01121ae49565 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:24.422651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d64f-36b6-4c69-a212-01121ae49565 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:24.422923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676d64f-36b6-4c69-a212-01121ae49565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:24.424693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1676d64f-36b6-4c69-a212-01121ae49565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:24.487431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676d64f-36b6-4c69-a212-01121ae49565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:24.488957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676d64f-36b6-4c69-a212-01121ae49565 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:24.498995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1251/2466] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:27.796765 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375d14d-e833-41b5-8b8d-303b3dbfba5a service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:27.809048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375d14d-e833-41b5-8b8d-303b3dbfba5a service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:27.813979 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:27.814708 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:27.815091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:27.815429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] PATH_INFO: `/v3/users/c86b3f2b8a3645749fc78c3aaf02c228` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:27.816889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86b3f2b8a3645749fc78c3aaf02c228)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:27.818877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:28.004760 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86b3f2b8a3645749fc78c3aaf02c228'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.010867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:28.014056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86b3f2b8a3645749fc78c3aaf02c228'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.075256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86b3f2b8a3645749fc78c3aaf02c228'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.088744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86b3f2b8a3645749fc78c3aaf02c228'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.089518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86b3f2b8a3645749fc78c3aaf02c228'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.099960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1216/2467] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:27 2022] DELETE /identity/v3/users/c86b3f2b8a3645749fc78c3aaf02c228 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:28.101714 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcfb68-eda6-44d3-a92e-013353a85175 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:28.102208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcfb68-eda6-44d3-a92e-013353a85175 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:28.102327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcfb68-eda6-44d3-a92e-013353a85175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:28.121774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-74bcfb68-eda6-44d3-a92e-013353a85175 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:28.122979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-74bcfb68-eda6-44d3-a92e-013353a85175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:28.128169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:28.182147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1252/2468] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:28.191824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:28.193480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:28.226695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcfb68-eda6-44d3-a92e-013353a85175 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:28.228327 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-74bcfb68-eda6-44d3-a92e-013353a85175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:28.243864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcfb68-eda6-44d3-a92e-013353a85175 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:28.248567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:28.249196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:28.249473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:28.249743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] PATH_INFO: `/v3/users/e0f0bf68631642c197600f557e999adc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:28.251707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f0bf68631642c197600f557e999adc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:28.253835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:28.261255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4cea0-c6a1-40f0-8cdd-c583dffd2836 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:28.265011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:28.265618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:28.266556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:28.266818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:28.276140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:28.277618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:28.287301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1217/2469] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:28.448471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f0bf68631642c197600f557e999adc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.457565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f0bf68631642c197600f557e999adc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.469171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f0bf68631642c197600f557e999adc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.551589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f0bf68631642c197600f557e999adc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.552424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f0bf68631642c197600f557e999adc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.559494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1253/2470] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:28 2022] DELETE /identity/v3/users/e0f0bf68631642c197600f557e999adc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:28.715790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:28.717347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:28.731079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf83ace-9cc6-4845-b5c4-80388d7ce000 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:28.792370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:28.792996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:28.793278 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:28.793550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] PATH_INFO: `/v3/projects/641f0baf7d5b4c56a75eed39e11103b9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:28.794697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] RBAC: Authorizing `identity:delete_project(project_id=641f0baf7d5b4c56a75eed39e11103b9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:28.796647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:28.808336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:28.810112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:28.835203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21064-d633-4589-ae5f-0fe2ed9b3869 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:28.840811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:28.841493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:28.841723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:28.841998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] PATH_INFO: `/v3/projects/c00ba20608984f95b8d9c7a2a1a42387` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:28.843171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00ba20608984f95b8d9c7a2a1a42387)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:28.846031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:28.893775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641f0baf7d5b4c56a75eed39e11103b9', 'request_id': 'req-1fcce7db-e9ac-41f5-a18c-3ca39217923a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.932092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00ba20608984f95b8d9c7a2a1a42387', 'request_id': 'req-32783e34-11a5-4ed1-bda4-044a273beba6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.938523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00ba20608984f95b8d9c7a2a1a42387', 'request_id': 'req-32783e34-11a5-4ed1-bda4-044a273beba6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.944166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00ba20608984f95b8d9c7a2a1a42387', 'request_id': 'req-32783e34-11a5-4ed1-bda4-044a273beba6'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.962013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641f0baf7d5b4c56a75eed39e11103b9', 'request_id': 'req-1fcce7db-e9ac-41f5-a18c-3ca39217923a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.968048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641f0baf7d5b4c56a75eed39e11103b9', 'request_id': 'req-1fcce7db-e9ac-41f5-a18c-3ca39217923a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.979134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] The token cache is being invalidate because project 641f0baf7d5b4c56a75eed39e11103b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:28.979423 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.980132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:28.981637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1218/2471] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:28 2022] DELETE /identity/v3/projects/641f0baf7d5b4c56a75eed39e11103b9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:28.985700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:28.986976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:28.991602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:29.036876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] The token cache is being invalidate because project c00ba20608984f95b8d9c7a2a1a42387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:29.037332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:29.038180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-32783e34-11a5-4ed1-bda4-044a273beba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:29.039710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1254/2472] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:28 2022] DELETE /identity/v3/projects/c00ba20608984f95b8d9c7a2a1a42387 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:29.045706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d6d2-c79f-4386-ae9a-417e25532e8d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.046026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d6d2-c79f-4386-ae9a-417e25532e8d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.046306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d6d2-c79f-4386-ae9a-417e25532e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.052612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcce7db-e9ac-41f5-a18c-3ca39217923a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.060584 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:29.066694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-19e2d6d2-c79f-4386-ae9a-417e25532e8d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:29.067915 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-19e2d6d2-c79f-4386-ae9a-417e25532e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:29.110360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.110997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.111327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.111676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] PATH_INFO: `/v3/users/8fb1119ea79d4164be974877b05cb0ca` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.112782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb1119ea79d4164be974877b05cb0ca)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:29.114740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:29.128363 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1255/2473] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:31:29.137401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7cf20-c383-4693-8b42-0f45b5553a8f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.137688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7cf20-c383-4693-8b42-0f45b5553a8f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.137965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7cf20-c383-4693-8b42-0f45b5553a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.158209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2ab7cf20-c383-4693-8b42-0f45b5553a8f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:29.159424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2ab7cf20-c383-4693-8b42-0f45b5553a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:29.167536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1256/2474] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:31:29.171485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7cf20-c383-4693-8b42-0f45b5553a8f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:29.180341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7cf20-c383-4693-8b42-0f45b5553a8f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.184946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.185529 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.185845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.186108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.186750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:31:29.187054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:29.189314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:29.200793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1257/2475] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:31:29.205599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:29.215336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd1217-ba46-44e1-a0ee-5e4e65b7814b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.220129 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165d570-4f8f-4671-a279-aa666892838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.220742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165d570-4f8f-4671-a279-aa666892838f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.221026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165d570-4f8f-4671-a279-aa666892838f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.221321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165d570-4f8f-4671-a279-aa666892838f admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.222003 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165d570-4f8f-4671-a279-aa666892838f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:29.223902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165d570-4f8f-4671-a279-aa666892838f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:29.308559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb1119ea79d4164be974877b05cb0ca'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:29.316171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb1119ea79d4164be974877b05cb0ca'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:29.325689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1258/2476] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:29 2022] POST /identity/v3/projects => generated 405 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:29.330450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165d570-4f8f-4671-a279-aa666892838f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:29.384078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb1119ea79d4164be974877b05cb0ca'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:29.394525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165d570-4f8f-4671-a279-aa666892838f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.400334 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afb276-882d-483a-b05c-e2e54cc8ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.400955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afb276-882d-483a-b05c-e2e54cc8ed37 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.401189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb1119ea79d4164be974877b05cb0ca'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:29.401314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afb276-882d-483a-b05c-e2e54cc8ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.401554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afb276-882d-483a-b05c-e2e54cc8ed37 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.402022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb1119ea79d4164be974877b05cb0ca'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:29.402141 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afb276-882d-483a-b05c-e2e54cc8ed37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:29.404167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afb276-882d-483a-b05c-e2e54cc8ed37 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:29.408976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1219/2477] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:28 2022] DELETE /identity/v3/users/8fb1119ea79d4164be974877b05cb0ca => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:29.530132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1259/2478] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:29 2022] POST /identity/v3/users => generated 303 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:29.531629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:29.533188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:29.567749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:29.599295 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e3a68-0be8-455b-87c2-616549dbff60 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.604046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836e93-e6b0-402f-a5b3-56df4d08f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.604683 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836e93-e6b0-402f-a5b3-56df4d08f7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.604965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836e93-e6b0-402f-a5b3-56df4d08f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.605238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836e93-e6b0-402f-a5b3-56df4d08f7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.605884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3836e93-e6b0-402f-a5b3-56df4d08f7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:29.607546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3836e93-e6b0-402f-a5b3-56df4d08f7e6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:29.618537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1220/2479] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:29.622706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afb276-882d-483a-b05c-e2e54cc8ed37 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:29.634975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afb276-882d-483a-b05c-e2e54cc8ed37 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.639848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c4bb9-927f-408f-bbae-9b3837eeae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.640503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4bb9-927f-408f-bbae-9b3837eeae23 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.640935 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4bb9-927f-408f-bbae-9b3837eeae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.641256 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c4bb9-927f-408f-bbae-9b3837eeae23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.641913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c4bb9-927f-408f-bbae-9b3837eeae23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:29.643576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c4bb9-927f-408f-bbae-9b3837eeae23 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:29.654743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1260/2480] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:29.659368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836e93-e6b0-402f-a5b3-56df4d08f7e6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:29.669822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836e93-e6b0-402f-a5b3-56df4d08f7e6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.688996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.689874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.690254 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.690543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] PATH_INFO: `/v3/projects/8e50ab478e824fc28eeeb5e0cda12f63/users/8a95262c18e44e24b0b1d2cfd5e31313/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.707356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e50ab478e824fc28eeeb5e0cda12f63, user_id=8a95262c18e44e24b0b1d2cfd5e31313, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:29.710315 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:29.806856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1221/2481] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:29 2022] PUT /identity/v3/projects/8e50ab478e824fc28eeeb5e0cda12f63/users/8a95262c18e44e24b0b1d2cfd5e31313/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:29.811874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8c6a6-7be1-41ec-a029-b29b3b9a1e08 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.812162 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8c6a6-7be1-41ec-a029-b29b3b9a1e08 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.812473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8c6a6-7be1-41ec-a029-b29b3b9a1e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.831644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-47c8c6a6-7be1-41ec-a029-b29b3b9a1e08 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:29.832899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-47c8c6a6-7be1-41ec-a029-b29b3b9a1e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:29.874722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:29.877046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:29.878493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:29.903398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1261/2482] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:29.911920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8c6a6-7be1-41ec-a029-b29b3b9a1e08 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:29.914292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-47c8c6a6-7be1-41ec-a029-b29b3b9a1e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:29.961335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5224-9cb5-4f24-a38c-8083da1861eb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.966465 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.967171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.967457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.967807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] PATH_INFO: `/v3/projects/6b49d77718a14b7a8846b2edda3bb251` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:29.970218 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b49d77718a14b7a8846b2edda3bb251)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:29.972545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:29.986187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8c6a6-7be1-41ec-a029-b29b3b9a1e08 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:29.990395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e3559-0bc6-43ab-bf57-b5ab8aeaffe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:29.991002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3559-0bc6-43ab-bf57-b5ab8aeaffe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:29.991284 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3559-0bc6-43ab-bf57-b5ab8aeaffe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:29.991727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e3559-0bc6-43ab-bf57-b5ab8aeaffe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.004868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e3559-0bc6-43ab-bf57-b5ab8aeaffe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:30.006305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e3559-0bc6-43ab-bf57-b5ab8aeaffe3 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:30.016799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1262/2483] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:31:30.122498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b49d77718a14b7a8846b2edda3bb251', 'request_id': 'req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:30.269334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b49d77718a14b7a8846b2edda3bb251', 'request_id': 'req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:30.276429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b49d77718a14b7a8846b2edda3bb251', 'request_id': 'req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:30.287633 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] The token cache is being invalidate because project 6b49d77718a14b7a8846b2edda3bb251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:30.287916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:30.288591 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c7acd44e-384c-46e8-b9c1-e04dc1b5f0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:30.290154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1222/2484] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:29 2022] DELETE /identity/v3/projects/6b49d77718a14b7a8846b2edda3bb251 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:30.297823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c7e31-d865-4206-ba0d-868c4399c27f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.297823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c7e31-d865-4206-ba0d-868c4399c27f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.297823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c7e31-d865-4206-ba0d-868c4399c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.319601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b05c7e31-d865-4206-ba0d-868c4399c27f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:30.320941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b05c7e31-d865-4206-ba0d-868c4399c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:30.387716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1263/2485] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:30.396621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f37e9-f112-4097-82d2-4cde09110232 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.396944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f37e9-f112-4097-82d2-4cde09110232 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.397248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f37e9-f112-4097-82d2-4cde09110232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.427572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6f4f37e9-f112-4097-82d2-4cde09110232 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:30.428834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6f4f37e9-f112-4097-82d2-4cde09110232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:30.436844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1223/2486] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:30.441937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c7e31-d865-4206-ba0d-868c4399c27f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:30.451848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c7e31-d865-4206-ba0d-868c4399c27f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:30.456741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:30.457355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.457631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.457901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.458547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:31:30.458913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:30.460536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:30.472916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1264/2487] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:31:30.477987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f37e9-f112-4097-82d2-4cde09110232 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:30.488647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f37e9-f112-4097-82d2-4cde09110232 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:30.493398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1879bd-7fb6-40bf-a1e4-c396fe35769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:30.494033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1879bd-7fb6-40bf-a1e4-c396fe35769e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.494308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1879bd-7fb6-40bf-a1e4-c396fe35769e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.494577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1879bd-7fb6-40bf-a1e4-c396fe35769e admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.495241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1879bd-7fb6-40bf-a1e4-c396fe35769e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:30.497182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1879bd-7fb6-40bf-a1e4-c396fe35769e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:30.620135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1224/2488] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:30 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:30.624242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:30.634727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104052-7ad6-48f0-b938-828823221ebe admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:30.691964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d7976-74a9-4d87-b7ab-14f02ab625f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:30.692607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d7976-74a9-4d87-b7ab-14f02ab625f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.692891 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d7976-74a9-4d87-b7ab-14f02ab625f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.693166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d7976-74a9-4d87-b7ab-14f02ab625f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.693809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d7976-74a9-4d87-b7ab-14f02ab625f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:30.695725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d7976-74a9-4d87-b7ab-14f02ab625f6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:30.784051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1265/2489] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:30 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:30.788249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1879bd-7fb6-40bf-a1e4-c396fe35769e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:30.793903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:30.800146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1879bd-7fb6-40bf-a1e4-c396fe35769e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:30.805087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81073d0-10a0-4ae0-bcec-f7f152ea7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:30.809196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81073d0-10a0-4ae0-bcec-f7f152ea7d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.809196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81073d0-10a0-4ae0-bcec-f7f152ea7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.809196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81073d0-10a0-4ae0-bcec-f7f152ea7d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.809196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81073d0-10a0-4ae0-bcec-f7f152ea7d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:30.809196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81073d0-10a0-4ae0-bcec-f7f152ea7d4e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:30.819170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1225/2490] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:30.823321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d7976-74a9-4d87-b7ab-14f02ab625f6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:30.830345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:30.834779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d7976-74a9-4d87-b7ab-14f02ab625f6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:30.841455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9177e-b60a-4c53-a671-963f7df95dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:30.842067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9177e-b60a-4c53-a671-963f7df95dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.842353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9177e-b60a-4c53-a671-963f7df95dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.842627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9177e-b60a-4c53-a671-963f7df95dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.843279 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9177e-b60a-4c53-a671-963f7df95dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:30.845655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9177e-b60a-4c53-a671-963f7df95dd9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:30.857053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1266/2491] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:30.861939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81073d0-10a0-4ae0-bcec-f7f152ea7d4e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:30.872198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81073d0-10a0-4ae0-bcec-f7f152ea7d4e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:30.877808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df1ac-b787-4a43-aded-fa63d70c37dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:30.878570 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df1ac-b787-4a43-aded-fa63d70c37dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.878852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df1ac-b787-4a43-aded-fa63d70c37dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.879119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df1ac-b787-4a43-aded-fa63d70c37dc admin admin] PATH_INFO: `/v3/projects/f9ab1b7d6fcd4dad8c3818babaf3905c/users/50a073019c2b444ba1eca3d7660d7dc7/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:30.894626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8df1ac-b787-4a43-aded-fa63d70c37dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ab1b7d6fcd4dad8c3818babaf3905c, user_id=50a073019c2b444ba1eca3d7660d7dc7, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:30.897502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8df1ac-b787-4a43-aded-fa63d70c37dc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:30.975090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1226/2492] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:30 2022] PUT /identity/v3/projects/f9ab1b7d6fcd4dad8c3818babaf3905c/users/50a073019c2b444ba1eca3d7660d7dc7/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:30.987041 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a064-d875-46f7-8bd7-b19fefe6b888 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:30.987326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a064-d875-46f7-8bd7-b19fefe6b888 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:30.987602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01a064-d875-46f7-8bd7-b19fefe6b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.017232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-3e01a064-d875-46f7-8bd7-b19fefe6b888 None None] MFA Rules not processed for user `50a073019c2b444ba1eca3d7660d7dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:31.018572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3e01a064-d875-46f7-8bd7-b19fefe6b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:31.085715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1267/2493] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:31.090363 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df1ac-b787-4a43-aded-fa63d70c37dc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.152552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df1ac-b787-4a43-aded-fa63d70c37dc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.159706 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538682ef-6500-49cd-8bee-5f75641f7be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.160494 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538682ef-6500-49cd-8bee-5f75641f7be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.161074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538682ef-6500-49cd-8bee-5f75641f7be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.161436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538682ef-6500-49cd-8bee-5f75641f7be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.162411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538682ef-6500-49cd-8bee-5f75641f7be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.164353 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538682ef-6500-49cd-8bee-5f75641f7be9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.293948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1227/2494] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:31 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:31.298347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a064-d875-46f7-8bd7-b19fefe6b888 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.309373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01a064-d875-46f7-8bd7-b19fefe6b888 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.335810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2920-06df-49d6-94bc-ca9800c7ba30 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.336120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2920-06df-49d6-94bc-ca9800c7ba30 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.336544 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df2920-06df-49d6-94bc-ca9800c7ba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.367915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-57df2920-06df-49d6-94bc-ca9800c7ba30 None None] MFA Rules not processed for user `8a95262c18e44e24b0b1d2cfd5e31313`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:31.369439 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-57df2920-06df-49d6-94bc-ca9800c7ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:31.377419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d7533-699a-4d06-b4e1-87d7deceb787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.378014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7533-699a-4d06-b4e1-87d7deceb787 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.378293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7533-699a-4d06-b4e1-87d7deceb787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.378567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7533-699a-4d06-b4e1-87d7deceb787 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.379205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d7533-699a-4d06-b4e1-87d7deceb787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.381249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d7533-699a-4d06-b4e1-87d7deceb787 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.441812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1228/2495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:31:31.446492 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df2920-06df-49d6-94bc-ca9800c7ba30 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.447891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-57df2920-06df-49d6-94bc-ca9800c7ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:31.462576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df2920-06df-49d6-94bc-ca9800c7ba30 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.467265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e7477-62d0-4d6f-a664-fd9cdc5cbad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.467889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e7477-62d0-4d6f-a664-fd9cdc5cbad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.468171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e7477-62d0-4d6f-a664-fd9cdc5cbad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.468508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e7477-62d0-4d6f-a664-fd9cdc5cbad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.469378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e7477-62d0-4d6f-a664-fd9cdc5cbad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.471376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e7477-62d0-4d6f-a664-fd9cdc5cbad9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.479474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1268/2496] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:31 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:31.484001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d7533-699a-4d06-b4e1-87d7deceb787 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.494787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d7533-699a-4d06-b4e1-87d7deceb787 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.499636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6d8a8-6b52-46e5-a1d9-05118250b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.500923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d8a8-6b52-46e5-a1d9-05118250b634 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.501268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d8a8-6b52-46e5-a1d9-05118250b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.501671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6d8a8-6b52-46e5-a1d9-05118250b634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.502512 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6d8a8-6b52-46e5-a1d9-05118250b634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.504203 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6d8a8-6b52-46e5-a1d9-05118250b634 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.515394 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1269/2497] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:31.520445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6d8a8-6b52-46e5-a1d9-05118250b634 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.532419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6d8a8-6b52-46e5-a1d9-05118250b634 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.537130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f5344-62dc-4245-993f-e68eb6b0c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.537826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f5344-62dc-4245-993f-e68eb6b0c576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.538108 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f5344-62dc-4245-993f-e68eb6b0c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.538382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f5344-62dc-4245-993f-e68eb6b0c576 admin admin] PATH_INFO: `/v3/projects/2f3a0f7723844a19b160753fd5a2e0c9/users/b7215b43948844eb82ea5990f014f0fc/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.555149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f5344-62dc-4245-993f-e68eb6b0c576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3a0f7723844a19b160753fd5a2e0c9, user_id=b7215b43948844eb82ea5990f014f0fc, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.557905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f5344-62dc-4245-993f-e68eb6b0c576 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.558770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1229/2498] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:31 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:31.564971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e7477-62d0-4d6f-a664-fd9cdc5cbad9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.589133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:31.629869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e7477-62d0-4d6f-a664-fd9cdc5cbad9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.634901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28ea5e-5504-4425-8735-6bc6616b4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.635514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28ea5e-5504-4425-8735-6bc6616b4bbe admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.635788 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28ea5e-5504-4425-8735-6bc6616b4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.636108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28ea5e-5504-4425-8735-6bc6616b4bbe admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.636793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28ea5e-5504-4425-8735-6bc6616b4bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.638733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28ea5e-5504-4425-8735-6bc6616b4bbe admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.658759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1270/2499] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:31 2022] PUT /identity/v3/projects/2f3a0f7723844a19b160753fd5a2e0c9/users/b7215b43948844eb82ea5990f014f0fc/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:31.662589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f5344-62dc-4245-993f-e68eb6b0c576 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.702832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:31.724570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f5344-62dc-4245-993f-e68eb6b0c576 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.729486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7fb72-3736-4afb-894d-20356439dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.730091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7fb72-3736-4afb-894d-20356439dcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.730368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7fb72-3736-4afb-894d-20356439dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.730641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7fb72-3736-4afb-894d-20356439dcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.731290 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7fb72-3736-4afb-894d-20356439dcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.732910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7fb72-3736-4afb-894d-20356439dcc8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.743144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1271/2500] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:31.747197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7fb72-3736-4afb-894d-20356439dcc8 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.756978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7fb72-3736-4afb-894d-20356439dcc8 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.762204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84d23-fd8f-4391-82d2-ebe0ae1f00df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.762970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84d23-fd8f-4391-82d2-ebe0ae1f00df admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.763384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84d23-fd8f-4391-82d2-ebe0ae1f00df admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.763726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84d23-fd8f-4391-82d2-ebe0ae1f00df admin admin] PATH_INFO: `/v3/projects/2f3a0f7723844a19b160753fd5a2e0c9/users/b7215b43948844eb82ea5990f014f0fc/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.766491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84d23-fd8f-4391-82d2-ebe0ae1f00df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3a0f7723844a19b160753fd5a2e0c9, user_id=b7215b43948844eb82ea5990f014f0fc, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.769296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84d23-fd8f-4391-82d2-ebe0ae1f00df admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.770278 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1230/2501] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:31 2022] POST /identity/v3/users => generated 308 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:31.774095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28ea5e-5504-4425-8735-6bc6616b4bbe admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.780450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1272/2502] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:31 2022] PUT /identity/v3/projects/2f3a0f7723844a19b160753fd5a2e0c9/users/b7215b43948844eb82ea5990f014f0fc/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:31.785061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28ea5e-5504-4425-8735-6bc6616b4bbe admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.792845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c4c2-46eb-4430-9903-bf3bade8178e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.793134 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c4c2-46eb-4430-9903-bf3bade8178e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.793408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c4c2-46eb-4430-9903-bf3bade8178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.821275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8da1c4c2-46eb-4430-9903-bf3bade8178e None None] MFA Rules not processed for user `b7215b43948844eb82ea5990f014f0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:31.822742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8da1c4c2-46eb-4430-9903-bf3bade8178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:31.843546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66b9ed-0375-4320-bc30-86d91f9124ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.844912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66b9ed-0375-4320-bc30-86d91f9124ac admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.845189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66b9ed-0375-4320-bc30-86d91f9124ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.845460 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66b9ed-0375-4320-bc30-86d91f9124ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.846141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66b9ed-0375-4320-bc30-86d91f9124ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.847764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66b9ed-0375-4320-bc30-86d91f9124ac admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.857745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1231/2503] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:31.862008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66b9ed-0375-4320-bc30-86d91f9124ac admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.872522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66b9ed-0375-4320-bc30-86d91f9124ac admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.878088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435403-7e59-42cd-906d-409a75249166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:31.879192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435403-7e59-42cd-906d-409a75249166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:31.879192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435403-7e59-42cd-906d-409a75249166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:31.879442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd435403-7e59-42cd-906d-409a75249166 admin admin] PATH_INFO: `/v3/projects/dd1bca9ec6d94b15b6c6002658523c4a/users/060b6a3312464f38a0faa76d92d10789/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:31.896936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd435403-7e59-42cd-906d-409a75249166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1bca9ec6d94b15b6c6002658523c4a, user_id=060b6a3312464f38a0faa76d92d10789, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:31.899717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd435403-7e59-42cd-906d-409a75249166 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:31.900885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1273/2504] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:31:31.912548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1c4c2-46eb-4430-9903-bf3bade8178e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:31.915462 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8da1c4c2-46eb-4430-9903-bf3bade8178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:31.969732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1232/2505] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:31 2022] PUT /identity/v3/projects/dd1bca9ec6d94b15b6c6002658523c4a/users/060b6a3312464f38a0faa76d92d10789/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:31.970168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1c4c2-46eb-4430-9903-bf3bade8178e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:31.973402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435403-7e59-42cd-906d-409a75249166 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:32.020785 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69667591-44b1-48c8-b4f2-a4ab78d89832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:32.021450 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667591-44b1-48c8-b4f2-a4ab78d89832 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:32.021729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667591-44b1-48c8-b4f2-a4ab78d89832 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:32.022004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69667591-44b1-48c8-b4f2-a4ab78d89832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:32.037193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd435403-7e59-42cd-906d-409a75249166 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:32.044890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6ae1-eb7d-43f8-a659-7d282145a7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:32.045551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6ae1-eb7d-43f8-a659-7d282145a7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:32.045825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6ae1-eb7d-43f8-a659-7d282145a7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:32.046277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6ae1-eb7d-43f8-a659-7d282145a7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:32.047761 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb6ae1-eb7d-43f8-a659-7d282145a7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:32.049443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb6ae1-eb7d-43f8-a659-7d282145a7c1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:32.057825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:32.064495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1233/2506] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:32.066034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6ae1-eb7d-43f8-a659-7d282145a7c1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:32.082247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6ae1-eb7d-43f8-a659-7d282145a7c1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:32.084780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60514658-18f7-430f-b09b-770a65b796dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:32.085466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60514658-18f7-430f-b09b-770a65b796dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:32.085747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60514658-18f7-430f-b09b-770a65b796dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:32.086099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60514658-18f7-430f-b09b-770a65b796dc admin admin] PATH_INFO: `/v3/projects/dd1bca9ec6d94b15b6c6002658523c4a/users/060b6a3312464f38a0faa76d92d10789/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:32.088076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60514658-18f7-430f-b09b-770a65b796dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1bca9ec6d94b15b6c6002658523c4a, user_id=060b6a3312464f38a0faa76d92d10789, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:32.090874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60514658-18f7-430f-b09b-770a65b796dc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:32.098579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667591-44b1-48c8-b4f2-a4ab78d89832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:32.100276 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69667591-44b1-48c8-b4f2-a4ab78d89832 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:32.102530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1234/2507] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:32 2022] PUT /identity/v3/projects/dd1bca9ec6d94b15b6c6002658523c4a/users/060b6a3312464f38a0faa76d92d10789/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:32.114644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1274/2508] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:31:32.740332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60514658-18f7-430f-b09b-770a65b796dc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:32.746576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:32.812449 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60514658-18f7-430f-b09b-770a65b796dc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:32.818260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:32.819132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:32.819916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:32.820199 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] PATH_INFO: `/v3/users/50a073019c2b444ba1eca3d7660d7dc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:32.821392 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a073019c2b444ba1eca3d7660d7dc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:32.823391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:32.992784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a073019c2b444ba1eca3d7660d7dc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:32.999672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a073019c2b444ba1eca3d7660d7dc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:33.085984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a073019c2b444ba1eca3d7660d7dc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:33.099790 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a073019c2b444ba1eca3d7660d7dc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:33.100487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a073019c2b444ba1eca3d7660d7dc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:33.106507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1235/2509] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:32 2022] DELETE /identity/v3/users/50a073019c2b444ba1eca3d7660d7dc7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:33.111811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a1a90-7c40-4b00-97e3-2794e64cfe79 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:33.112320 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a1a90-7c40-4b00-97e3-2794e64cfe79 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:33.112440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a1a90-7c40-4b00-97e3-2794e64cfe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:33.131229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-411a1a90-7c40-4b00-97e3-2794e64cfe79 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:33.132473 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-411a1a90-7c40-4b00-97e3-2794e64cfe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:33.206080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1275/2510] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:33.216175 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:33.217659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:33.282602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74456e-af1f-424e-b1da-80a9f7fb194e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:33.286231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:33.286830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:33.287107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:33.287373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:33.297054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:33.298537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:33.308624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1236/2511] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:33.432709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ca96-6575-4d40-b967-7873ca6ca8cc None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:33.433105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ca96-6575-4d40-b967-7873ca6ca8cc None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:33.433393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ca96-6575-4d40-b967-7873ca6ca8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:33.462523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-0fb4ca96-6575-4d40-b967-7873ca6ca8cc None None] MFA Rules not processed for user `060b6a3312464f38a0faa76d92d10789`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:33.463788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-0fb4ca96-6575-4d40-b967-7873ca6ca8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:33.584477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1276/2512] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:33.770697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:33.772430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:33.786945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef49c60-f319-4ffc-9407-7fade49cc56e service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:33.798009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:33.799257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:33.799741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:33.800807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] PATH_INFO: `/v3/projects/f9ab1b7d6fcd4dad8c3818babaf3905c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:33.802480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ab1b7d6fcd4dad8c3818babaf3905c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:33.804921 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:33.829310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:33.930376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ab1b7d6fcd4dad8c3818babaf3905c', 'request_id': 'req-de438398-b892-49a8-ac80-f9d5c50fb519'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.032784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ab1b7d6fcd4dad8c3818babaf3905c', 'request_id': 'req-de438398-b892-49a8-ac80-f9d5c50fb519'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.040115 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ab1b7d6fcd4dad8c3818babaf3905c', 'request_id': 'req-de438398-b892-49a8-ac80-f9d5c50fb519'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.051536 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] The token cache is being invalidate because project f9ab1b7d6fcd4dad8c3818babaf3905c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:34.057573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.057573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.057573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1237/2513] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:33 2022] DELETE /identity/v3/projects/f9ab1b7d6fcd4dad8c3818babaf3905c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:34.058231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4ca96-6575-4d40-b967-7873ca6ca8cc None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:34.069333 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4ca96-6575-4d40-b967-7873ca6ca8cc None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:34.104779 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:34.128078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:34.128765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:34.129009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:34.129289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] PATH_INFO: `/v3/users/b7215b43948844eb82ea5990f014f0fc` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:34.130386 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7215b43948844eb82ea5990f014f0fc)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:34.132322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:34.163114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:34.166351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:34.237125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de438398-b892-49a8-ac80-f9d5c50fb519 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:34.242236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:34.242846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:34.243124 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:34.243396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:34.245151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:34.259318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:34.259318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:34.268780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1238/2514] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:31:34.329693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7215b43948844eb82ea5990f014f0fc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.338042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7215b43948844eb82ea5990f014f0fc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.351607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7215b43948844eb82ea5990f014f0fc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.397351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7215b43948844eb82ea5990f014f0fc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.397972 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7215b43948844eb82ea5990f014f0fc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:34.404559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1277/2515] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:34 2022] DELETE /identity/v3/users/b7215b43948844eb82ea5990f014f0fc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:34.798647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:34.800123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:34.814623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2ab7c-f3ff-4041-a20b-2d31c41fe06a service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:34.889259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:34.890244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:34.890621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:34.890952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] PATH_INFO: `/v3/projects/2f3a0f7723844a19b160753fd5a2e0c9` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:34.892907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f3a0f7723844a19b160753fd5a2e0c9)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:34.895377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.016880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.018899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.030876 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:35.033257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e88f8-e583-4540-9c91-2409fe48c74e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.037296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f3a0f7723844a19b160753fd5a2e0c9', 'request_id': 'req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.088626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f3a0f7723844a19b160753fd5a2e0c9', 'request_id': 'req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.090525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.091167 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.091445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.091717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] PATH_INFO: `/v3/users/8a95262c18e44e24b0b1d2cfd5e31313` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.092877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a95262c18e44e24b0b1d2cfd5e31313)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.094868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.095745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f3a0f7723844a19b160753fd5a2e0c9', 'request_id': 'req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.106193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] The token cache is being invalidate because project 2f3a0f7723844a19b160753fd5a2e0c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:35.106482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.107180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-01be4cd5-b9c1-452a-aeb3-3c71d8531c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.108817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1239/2516] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:34 2022] DELETE /identity/v3/projects/2f3a0f7723844a19b160753fd5a2e0c9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:35.113665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d1cc-a120-4ce0-86ad-859e6737681e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.113947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d1cc-a120-4ce0-86ad-859e6737681e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.114221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d1cc-a120-4ce0-86ad-859e6737681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.134230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4610d1cc-a120-4ce0-86ad-859e6737681e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:35.135436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4610d1cc-a120-4ce0-86ad-859e6737681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.144104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1240/2517] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:35.151759 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ed1de-fe06-4ae2-aa05-acd965e01c92 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.152043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ed1de-fe06-4ae2-aa05-acd965e01c92 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.152342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ed1de-fe06-4ae2-aa05-acd965e01c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.171209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-394ed1de-fe06-4ae2-aa05-acd965e01c92 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:35.172684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-394ed1de-fe06-4ae2-aa05-acd965e01c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.183783 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1241/2518] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:31:35.184947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ed1de-fe06-4ae2-aa05-acd965e01c92 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.194100 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ed1de-fe06-4ae2-aa05-acd965e01c92 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.198937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.201179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.201179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.201179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.201179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:31:35.201179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.202678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.214802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1242/2519] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:31:35.219010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.228804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229705-f2c1-498b-822a-cc340cdb43eb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.233471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a775c6-b91b-4a8c-b42f-ce9f55604970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.234042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a775c6-b91b-4a8c-b42f-ce9f55604970 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.234411 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a775c6-b91b-4a8c-b42f-ce9f55604970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.234691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a775c6-b91b-4a8c-b42f-ce9f55604970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.235314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a775c6-b91b-4a8c-b42f-ce9f55604970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.237235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a775c6-b91b-4a8c-b42f-ce9f55604970 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.308392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a95262c18e44e24b0b1d2cfd5e31313'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.315763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a95262c18e44e24b0b1d2cfd5e31313'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.317719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:35.328798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a95262c18e44e24b0b1d2cfd5e31313'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.334591 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1243/2520] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:35 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:35.335564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a775c6-b91b-4a8c-b42f-ce9f55604970 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.394973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a775c6-b91b-4a8c-b42f-ce9f55604970 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.399671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af328e5e-d5ad-4ccb-96b3-2e1c24f9f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.400278 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328e5e-d5ad-4ccb-96b3-2e1c24f9f151 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.400595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328e5e-d5ad-4ccb-96b3-2e1c24f9f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.400864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af328e5e-d5ad-4ccb-96b3-2e1c24f9f151 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.401496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af328e5e-d5ad-4ccb-96b3-2e1c24f9f151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.403431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af328e5e-d5ad-4ccb-96b3-2e1c24f9f151 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.408232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a95262c18e44e24b0b1d2cfd5e31313'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.409009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a95262c18e44e24b0b1d2cfd5e31313'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.415562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1278/2521] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:35 2022] DELETE /identity/v3/users/8a95262c18e44e24b0b1d2cfd5e31313 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:35.480691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1244/2522] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:35 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:35.487836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.489324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.556681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a40525-7cc4-487e-8da4-d955d6ac7984 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.562032 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f41d6-da63-485f-ba12-0936bea53276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.563062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f41d6-da63-485f-ba12-0936bea53276 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.563515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f41d6-da63-485f-ba12-0936bea53276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.564443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f41d6-da63-485f-ba12-0936bea53276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.565114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f41d6-da63-485f-ba12-0936bea53276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.566733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f41d6-da63-485f-ba12-0936bea53276 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.577635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1279/2523] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:35.582219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af328e5e-d5ad-4ccb-96b3-2e1c24f9f151 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.592482 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af328e5e-d5ad-4ccb-96b3-2e1c24f9f151 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.598104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.598705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.598986 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.599274 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.599901 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.601632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.611951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1245/2524] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:35.616410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f41d6-da63-485f-ba12-0936bea53276 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.626660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f41d6-da63-485f-ba12-0936bea53276 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.631472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a5ea5-f9ab-4fc9-8c62-6da3b39c8495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.632114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a5ea5-f9ab-4fc9-8c62-6da3b39c8495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.632428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a5ea5-f9ab-4fc9-8c62-6da3b39c8495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.632703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a5ea5-f9ab-4fc9-8c62-6da3b39c8495 admin admin] PATH_INFO: `/v3/projects/f6986c41ef77426b901300fc805541d2/users/b82851b0ce0842568cc5a839471c052f/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.652468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a5ea5-f9ab-4fc9-8c62-6da3b39c8495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6986c41ef77426b901300fc805541d2, user_id=b82851b0ce0842568cc5a839471c052f, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.652468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a5ea5-f9ab-4fc9-8c62-6da3b39c8495 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.679324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.681108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.694078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99093fc7-ab43-4450-a39a-48201a79ca83 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.699198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.699829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.700106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.700432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] PATH_INFO: `/v3/projects/8e50ab478e824fc28eeeb5e0cda12f63` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.701568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e50ab478e824fc28eeeb5e0cda12f63)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.704034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.772951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1280/2525] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:35 2022] PUT /identity/v3/projects/f6986c41ef77426b901300fc805541d2/users/b82851b0ce0842568cc5a839471c052f/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:35.784352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4acd-4e94-490b-9a75-56bb38534bc4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.784640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4acd-4e94-490b-9a75-56bb38534bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.784913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4acd-4e94-490b-9a75-56bb38534bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.812012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8b7c4acd-4e94-490b-9a75-56bb38534bc4 None None] MFA Rules not processed for user `b82851b0ce0842568cc5a839471c052f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:35.813774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b7c4acd-4e94-490b-9a75-56bb38534bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.815522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e50ab478e824fc28eeeb5e0cda12f63', 'request_id': 'req-05fc77f6-e081-4e1f-871e-c5cc105e5faf'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.819202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:DELETE=9,keystone:INSERT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:35.879046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1281/2526] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:31:35.890354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4acd-4e94-490b-9a75-56bb38534bc4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.892282 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8b7c4acd-4e94-490b-9a75-56bb38534bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.897943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e50ab478e824fc28eeeb5e0cda12f63', 'request_id': 'req-05fc77f6-e081-4e1f-871e-c5cc105e5faf'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.905491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e50ab478e824fc28eeeb5e0cda12f63', 'request_id': 'req-05fc77f6-e081-4e1f-871e-c5cc105e5faf'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.916817 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] The token cache is being invalidate because project 8e50ab478e824fc28eeeb5e0cda12f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:35.917116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.917856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:35.919388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1246/2527] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:35 2022] DELETE /identity/v3/projects/8e50ab478e824fc28eeeb5e0cda12f63 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:35.923425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:35.925303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.934073 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:35.949720 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4acd-4e94-490b-9a75-56bb38534bc4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:35.954241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:35.954846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:35.955278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:35.955558 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:35.957447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:35.970213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:35.971587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:35.982499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1282/2528] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:31:35.996098 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc77f6-e081-4e1f-871e-c5cc105e5faf admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:36.001311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:36.002589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:36.002869 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:36.003143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] PATH_INFO: `/v3/users/060b6a3312464f38a0faa76d92d10789` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:36.004306 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060b6a3312464f38a0faa76d92d10789)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:36.006864 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:36.191847 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060b6a3312464f38a0faa76d92d10789'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.199143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060b6a3312464f38a0faa76d92d10789'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.294818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060b6a3312464f38a0faa76d92d10789'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.308373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060b6a3312464f38a0faa76d92d10789'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.310256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0947dd9-0a93-4e19-98ac-080bcadb4695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060b6a3312464f38a0faa76d92d10789'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.315863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1247/2529] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:35 2022] DELETE /identity/v3/users/060b6a3312464f38a0faa76d92d10789 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:36.591058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:36.605765 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84921e6-b752-4a11-b4c9-d1b0919da2c1 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:36.673384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:36.674045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:36.674323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:36.674594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] PATH_INFO: `/v3/projects/dd1bca9ec6d94b15b6c6002658523c4a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:36.675702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1bca9ec6d94b15b6c6002658523c4a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:36.677631 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:36.804795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1bca9ec6d94b15b6c6002658523c4a', 'request_id': 'req-03cb130f-366d-433f-984f-e392a7922c8e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.810835 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1bca9ec6d94b15b6c6002658523c4a', 'request_id': 'req-03cb130f-366d-433f-984f-e392a7922c8e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.816929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1bca9ec6d94b15b6c6002658523c4a', 'request_id': 'req-03cb130f-366d-433f-984f-e392a7922c8e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.892077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] The token cache is being invalidate because project dd1bca9ec6d94b15b6c6002658523c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:36.892419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.893051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-03cb130f-366d-433f-984f-e392a7922c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:36.894552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1283/2530] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:36 2022] DELETE /identity/v3/projects/dd1bca9ec6d94b15b6c6002658523c4a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:36.899509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f0e7f-e348-4fd2-a58e-ee591764843f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:36.899802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f0e7f-e348-4fd2-a58e-ee591764843f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:36.900082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f0e7f-e348-4fd2-a58e-ee591764843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:36.919500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-462f0e7f-e348-4fd2-a58e-ee591764843f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:36.924429 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-462f0e7f-e348-4fd2-a58e-ee591764843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:36.978757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1248/2531] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:36.988421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f30c1-ed2b-4ae4-bb9d-568135a42abd None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:36.988713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f30c1-ed2b-4ae4-bb9d-568135a42abd None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:36.988996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f30c1-ed2b-4ae4-bb9d-568135a42abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.010431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4a4f30c1-ed2b-4ae4-bb9d-568135a42abd None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:37.016101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4a4f30c1-ed2b-4ae4-bb9d-568135a42abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:37.019642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1284/2532] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:37.024455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f0e7f-e348-4fd2-a58e-ee591764843f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:37.029561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:37.035012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f0e7f-e348-4fd2-a58e-ee591764843f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:37.039504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:37.040126 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.040444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.040721 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.041377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:31:37.041679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:37.043284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:37.059128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1249/2533] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:31:37.062991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f30c1-ed2b-4ae4-bb9d-568135a42abd None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:37.072241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f30c1-ed2b-4ae4-bb9d-568135a42abd None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:37.077181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e3f-401f-4349-919f-973464a1fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:37.077781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e3f-401f-4349-919f-973464a1fa07 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.078088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e3f-401f-4349-919f-973464a1fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.078362 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e3f-401f-4349-919f-973464a1fa07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.079026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06e3f-401f-4349-919f-973464a1fa07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:37.080997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f06e3f-401f-4349-919f-973464a1fa07 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:37.178367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1285/2534] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:37 2022] POST /identity/v3/projects => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:37.182513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:37.193143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09eb31-1721-474b-9a93-9c89fd0327b9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:37.249944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b05a-418c-406f-9976-691272c32f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:37.251360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b05a-418c-406f-9976-691272c32f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.251648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b05a-418c-406f-9976-691272c32f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.251927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b05a-418c-406f-9976-691272c32f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.252647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b05a-418c-406f-9976-691272c32f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:37.254627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b05a-418c-406f-9976-691272c32f37 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:37.358151 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1250/2535] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:37 2022] POST /identity/v3/users => generated 279 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:37.362874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e3f-401f-4349-919f-973464a1fa07 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:37.373083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e3f-401f-4349-919f-973464a1fa07 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:37.378764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc1b69-62a0-478f-add3-a03b4fc17ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:37.379369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc1b69-62a0-478f-add3-a03b4fc17ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.379659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc1b69-62a0-478f-add3-a03b4fc17ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.380020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc1b69-62a0-478f-add3-a03b4fc17ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.380710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc1b69-62a0-478f-add3-a03b4fc17ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:37.382440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc1b69-62a0-478f-add3-a03b4fc17ac6 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:37.393822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1286/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:37.397807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b05a-418c-406f-9976-691272c32f37 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:37.408323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b05a-418c-406f-9976-691272c32f37 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:37.413099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750a680-6e39-48ba-8e9b-24a735f2850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:37.414099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750a680-6e39-48ba-8e9b-24a735f2850a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.414099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750a680-6e39-48ba-8e9b-24a735f2850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.414341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750a680-6e39-48ba-8e9b-24a735f2850a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.414883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750a680-6e39-48ba-8e9b-24a735f2850a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:37.416514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750a680-6e39-48ba-8e9b-24a735f2850a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:37.427858 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1251/2537] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:37.432045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc1b69-62a0-478f-add3-a03b4fc17ac6 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:37.442097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc1b69-62a0-478f-add3-a03b4fc17ac6 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:37.446931 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce215b5-c1ef-4a12-9bb7-27327b04d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:37.447594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce215b5-c1ef-4a12-9bb7-27327b04d287 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.447875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce215b5-c1ef-4a12-9bb7-27327b04d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.448150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce215b5-c1ef-4a12-9bb7-27327b04d287 admin admin] PATH_INFO: `/v3/projects/a826cf4183e44db5aa6780dbfb973ef0/users/583ca8e4a04a498ebde9faeacd8936ca/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.462625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce215b5-c1ef-4a12-9bb7-27327b04d287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a826cf4183e44db5aa6780dbfb973ef0, user_id=583ca8e4a04a498ebde9faeacd8936ca, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:37.465342 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce215b5-c1ef-4a12-9bb7-27327b04d287 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:37.528663 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1287/2538] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:37 2022] PUT /identity/v3/projects/a826cf4183e44db5aa6780dbfb973ef0/users/583ca8e4a04a498ebde9faeacd8936ca/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:37.539417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3387-c505-4ea0-951e-7f8761c3857f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.539723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3387-c505-4ea0-951e-7f8761c3857f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.540018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f3387-c505-4ea0-951e-7f8761c3857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.568659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-f49f3387-c505-4ea0-951e-7f8761c3857f None None] MFA Rules not processed for user `583ca8e4a04a498ebde9faeacd8936ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:37.569827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f49f3387-c505-4ea0-951e-7f8761c3857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:37.633235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1252/2539] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:37.638069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce215b5-c1ef-4a12-9bb7-27327b04d287 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:37.647745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:37.701268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce215b5-c1ef-4a12-9bb7-27327b04d287 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:37.706681 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d6701-54b8-4589-ac8b-46ff00070106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:37.707286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d6701-54b8-4589-ac8b-46ff00070106 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.707566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d6701-54b8-4589-ac8b-46ff00070106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.707838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d6701-54b8-4589-ac8b-46ff00070106 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.708498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d6701-54b8-4589-ac8b-46ff00070106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:37.710485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d6701-54b8-4589-ac8b-46ff00070106 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:37.827420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1288/2540] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:37 2022] POST /identity/v3/projects => generated 357 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:37.832486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f3387-c505-4ea0-951e-7f8761c3857f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:37.843331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f3387-c505-4ea0-951e-7f8761c3857f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:37.961929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:37.961929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0decc-d6a0-4622-a309-3cfbf23a6229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:37.961929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0decc-d6a0-4622-a309-3cfbf23a6229 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:37.961929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0decc-d6a0-4622-a309-3cfbf23a6229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:37.962385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0decc-d6a0-4622-a309-3cfbf23a6229 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:37.962385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0decc-d6a0-4622-a309-3cfbf23a6229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:37.962385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0decc-d6a0-4622-a309-3cfbf23a6229 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:38.024563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1253/2541] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:37 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:38.028578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d6701-54b8-4589-ac8b-46ff00070106 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:38.038930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d6701-54b8-4589-ac8b-46ff00070106 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:38.043568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879561ff-a35b-44e9-84b4-f6cf03602fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:38.045265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879561ff-a35b-44e9-84b4-f6cf03602fed admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:38.045265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879561ff-a35b-44e9-84b4-f6cf03602fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:38.045265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879561ff-a35b-44e9-84b4-f6cf03602fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:38.045549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879561ff-a35b-44e9-84b4-f6cf03602fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:38.047119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879561ff-a35b-44e9-84b4-f6cf03602fed admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:38.058395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1289/2542] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:38.063270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0decc-d6a0-4622-a309-3cfbf23a6229 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:38.073051 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0decc-d6a0-4622-a309-3cfbf23a6229 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:38.079107 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4cd85-90e1-418f-a93f-bf21d09da126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:38.079985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4cd85-90e1-418f-a93f-bf21d09da126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:38.080395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4cd85-90e1-418f-a93f-bf21d09da126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:38.080671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4cd85-90e1-418f-a93f-bf21d09da126 admin admin] PATH_INFO: `/v3/projects/463f240612f749ea9edf19177ce81291/users/fdf8f8c3b9b34b4eaa6e45b1a132062b/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:38.095948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4cd85-90e1-418f-a93f-bf21d09da126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463f240612f749ea9edf19177ce81291, user_id=fdf8f8c3b9b34b4eaa6e45b1a132062b, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:38.099044 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4cd85-90e1-418f-a93f-bf21d09da126 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:38.183521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1254/2543] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:38 2022] PUT /identity/v3/projects/463f240612f749ea9edf19177ce81291/users/fdf8f8c3b9b34b4eaa6e45b1a132062b/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:38.188038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879561ff-a35b-44e9-84b4-f6cf03602fed admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:38.198181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879561ff-a35b-44e9-84b4-f6cf03602fed admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:38.259664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdc37b-0d61-401a-894a-0beb41986e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:38.260264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc37b-0d61-401a-894a-0beb41986e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:38.260569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc37b-0d61-401a-894a-0beb41986e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:38.260839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdc37b-0d61-401a-894a-0beb41986e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:38.261508 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdc37b-0d61-401a-894a-0beb41986e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:38.263118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdc37b-0d61-401a-894a-0beb41986e0e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:38.273723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1290/2544] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:38.277964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4cd85-90e1-418f-a93f-bf21d09da126 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:38.288718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4cd85-90e1-418f-a93f-bf21d09da126 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:38.293332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:38.293974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:38.297308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:38.297308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] PATH_INFO: `/v3/projects/463f240612f749ea9edf19177ce81291/users/fdf8f8c3b9b34b4eaa6e45b1a132062b/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:38.297308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463f240612f749ea9edf19177ce81291, user_id=fdf8f8c3b9b34b4eaa6e45b1a132062b, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:38.299426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:38.309504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1255/2545] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:38 2022] PUT /identity/v3/projects/463f240612f749ea9edf19177ce81291/users/fdf8f8c3b9b34b4eaa6e45b1a132062b/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:38.321288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744e3f-6773-4f82-9150-1ded45a98ba2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:38.321620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744e3f-6773-4f82-9150-1ded45a98ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:38.321894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d744e3f-6773-4f82-9150-1ded45a98ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:38.351317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1d744e3f-6773-4f82-9150-1ded45a98ba2 None None] MFA Rules not processed for user `fdf8f8c3b9b34b4eaa6e45b1a132062b`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:38.352734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1d744e3f-6773-4f82-9150-1ded45a98ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:38.429183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1291/2546] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:38.441745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:38.443580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:38.513404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cede96-0bb9-4bff-877f-196af499c831 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:38.517633 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:38.518264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:38.518540 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:38.518808 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:38.528137 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:38.529596 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:38.539329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1256/2547] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:38.763739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d744e3f-6773-4f82-9150-1ded45a98ba2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:38.768661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:38.774153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d744e3f-6773-4f82-9150-1ded45a98ba2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:38.777825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81ab50-4d8e-49e3-a84f-f24e945496b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:38.778458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ab50-4d8e-49e3-a84f-f24e945496b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:38.778739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ab50-4d8e-49e3-a84f-f24e945496b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:38.779010 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ab50-4d8e-49e3-a84f-f24e945496b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:38.838209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81ab50-4d8e-49e3-a84f-f24e945496b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:38.839695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81ab50-4d8e-49e3-a84f-f24e945496b2 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:38.849318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1292/2548] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:42.818004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:42.818004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:42.889074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36335388-52f1-4a54-9b96-033de241d0ba service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:42.894227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:42.894856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:42.895133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:42.895405 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] PATH_INFO: `/v3/users/b82851b0ce0842568cc5a839471c052f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:42.896560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82851b0ce0842568cc5a839471c052f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:42.898526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:43.097957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82851b0ce0842568cc5a839471c052f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:43.104422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:43.107495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82851b0ce0842568cc5a839471c052f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:43.180177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82851b0ce0842568cc5a839471c052f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:43.198850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82851b0ce0842568cc5a839471c052f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:43.201689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82851b0ce0842568cc5a839471c052f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:43.206742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1257/2549] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:42 2022] DELETE /identity/v3/users/b82851b0ce0842568cc5a839471c052f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:43.211143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a0e0-334a-4599-92ef-e33449aa08da None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:43.211625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a0e0-334a-4599-92ef-e33449aa08da None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:43.211750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8a0e0-334a-4599-92ef-e33449aa08da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:43.231478 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-10e8a0e0-334a-4599-92ef-e33449aa08da None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:43.232719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-10e8a0e0-334a-4599-92ef-e33449aa08da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:43.290479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1293/2550] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:43.300381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:43.301766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:43.357514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d675853-11ea-4d32-bbf9-845b3801f07f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:43.361210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c93b9e-f62e-4e1e-9925-5f28d21a8c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:43.361805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93b9e-f62e-4e1e-9925-5f28d21a8c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:43.362084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93b9e-f62e-4e1e-9925-5f28d21a8c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:43.362354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93b9e-f62e-4e1e-9925-5f28d21a8c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:43.371112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c93b9e-f62e-4e1e-9925-5f28d21a8c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:43.372576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c93b9e-f62e-4e1e-9925-5f28d21a8c75 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:43.382441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1258/2551] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:43.799814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8a0e0-334a-4599-92ef-e33449aa08da None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:43.801585 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-10e8a0e0-334a-4599-92ef-e33449aa08da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:43.819047 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8a0e0-334a-4599-92ef-e33449aa08da None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:43.826097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:43.827296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:43.827734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:43.828392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] PATH_INFO: `/v3/projects/f6986c41ef77426b901300fc805541d2` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:43.831286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6986c41ef77426b901300fc805541d2)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:43.833419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:43.987539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6986c41ef77426b901300fc805541d2', 'request_id': 'req-2795fdf7-53f2-41f6-8901-8c45e11c18b9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:43.987539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6986c41ef77426b901300fc805541d2', 'request_id': 'req-2795fdf7-53f2-41f6-8901-8c45e11c18b9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:43.987539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6986c41ef77426b901300fc805541d2', 'request_id': 'req-2795fdf7-53f2-41f6-8901-8c45e11c18b9'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:44.051848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] The token cache is being invalidate because project f6986c41ef77426b901300fc805541d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:44.052171 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:44.052820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2795fdf7-53f2-41f6-8901-8c45e11c18b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:44.054295 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1294/2552] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:43 2022] DELETE /identity/v3/projects/f6986c41ef77426b901300fc805541d2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:44.059214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e550e0-c6ab-4e20-af15-5f193651b1e6 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.059697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e550e0-c6ab-4e20-af15-5f193651b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.059802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e550e0-c6ab-4e20-af15-5f193651b1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.084664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-64e550e0-c6ab-4e20-af15-5f193651b1e6 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:44.084664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-64e550e0-c6ab-4e20-af15-5f193651b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:44.145074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1259/2553] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:44.152987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547974e-ad7f-4136-8ffb-9708be501e43 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.153401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547974e-ad7f-4136-8ffb-9708be501e43 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.153648 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547974e-ad7f-4136-8ffb-9708be501e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.175397 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e547974e-ad7f-4136-8ffb-9708be501e43 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:44.176653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e547974e-ad7f-4136-8ffb-9708be501e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:44.184439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1295/2554] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:44.188839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e550e0-c6ab-4e20-af15-5f193651b1e6 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:44.198637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e550e0-c6ab-4e20-af15-5f193651b1e6 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:44.203282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:44.203886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.204167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.205006 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.205313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:31:44.205623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:44.207253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:44.218720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1260/2555] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:31:44.223488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547974e-ad7f-4136-8ffb-9708be501e43 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:44.235042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547974e-ad7f-4136-8ffb-9708be501e43 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:44.238976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29948734-5f02-4b25-ae3c-550901c752fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:44.239539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948734-5f02-4b25-ae3c-550901c752fc admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.239826 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948734-5f02-4b25-ae3c-550901c752fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.240100 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948734-5f02-4b25-ae3c-550901c752fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.240778 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29948734-5f02-4b25-ae3c-550901c752fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:44.242833 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29948734-5f02-4b25-ae3c-550901c752fc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:44.259124 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:44.353732 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1296/2556] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:44 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:44.354956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:44.366068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e996be4-da01-4b3c-bc98-1f066e403170 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:44.426316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bc9c6-0c80-4ba3-ba41-75a245209e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:44.426955 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc9c6-0c80-4ba3-ba41-75a245209e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.427234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc9c6-0c80-4ba3-ba41-75a245209e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.427503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bc9c6-0c80-4ba3-ba41-75a245209e68 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.428128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bc9c6-0c80-4ba3-ba41-75a245209e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:44.430104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bc9c6-0c80-4ba3-ba41-75a245209e68 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:44.439083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:44.523837 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1261/2557] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:44 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:44.528066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29948734-5f02-4b25-ae3c-550901c752fc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:44.539686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29948734-5f02-4b25-ae3c-550901c752fc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:44.544554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4da900-426a-482c-9b30-8ff6f810b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:44.549238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da900-426a-482c-9b30-8ff6f810b866 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.549238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da900-426a-482c-9b30-8ff6f810b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.549238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4da900-426a-482c-9b30-8ff6f810b866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.549238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4da900-426a-482c-9b30-8ff6f810b866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:44.549238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4da900-426a-482c-9b30-8ff6f810b866 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:44.559531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1297/2558] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:44.563556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bc9c6-0c80-4ba3-ba41-75a245209e68 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:44.573491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bc9c6-0c80-4ba3-ba41-75a245209e68 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:44.578060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be9d4e-6818-4643-ae30-40284a7173ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:44.578650 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9d4e-6818-4643-ae30-40284a7173ff admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.578923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9d4e-6818-4643-ae30-40284a7173ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.579689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9d4e-6818-4643-ae30-40284a7173ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.580345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be9d4e-6818-4643-ae30-40284a7173ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:44.581932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be9d4e-6818-4643-ae30-40284a7173ff admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:44.592227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1262/2559] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:44.597352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4da900-426a-482c-9b30-8ff6f810b866 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:44.606990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4da900-426a-482c-9b30-8ff6f810b866 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:44.611774 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8217fc-c46b-4b0e-b59c-48d6b34e05d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:44.612441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8217fc-c46b-4b0e-b59c-48d6b34e05d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.612723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8217fc-c46b-4b0e-b59c-48d6b34e05d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.612994 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8217fc-c46b-4b0e-b59c-48d6b34e05d4 admin admin] PATH_INFO: `/v3/projects/038364c423c844738e010d31f3befc59/users/947121da298a401b85a24c076de6962f/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.627422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8217fc-c46b-4b0e-b59c-48d6b34e05d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038364c423c844738e010d31f3befc59, user_id=947121da298a401b85a24c076de6962f, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:44.630112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8217fc-c46b-4b0e-b59c-48d6b34e05d4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:44.723727 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1298/2560] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:44 2022] PUT /identity/v3/projects/038364c423c844738e010d31f3befc59/users/947121da298a401b85a24c076de6962f/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:44.735101 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3f8d9-ff38-45af-8857-6310d96671ca None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.735430 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3f8d9-ff38-45af-8857-6310d96671ca None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.735775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3f8d9-ff38-45af-8857-6310d96671ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.763271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-64c3f8d9-ff38-45af-8857-6310d96671ca None None] MFA Rules not processed for user `947121da298a401b85a24c076de6962f`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:44.764520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-64c3f8d9-ff38-45af-8857-6310d96671ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:44.827303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1263/2561] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:44.832599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8217fc-c46b-4b0e-b59c-48d6b34e05d4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:44.897955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8217fc-c46b-4b0e-b59c-48d6b34e05d4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:44.902819 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad35d5-5319-4ebc-aa56-03c3c37de936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:44.903420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad35d5-5319-4ebc-aa56-03c3c37de936 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:44.903695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad35d5-5319-4ebc-aa56-03c3c37de936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:44.903964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad35d5-5319-4ebc-aa56-03c3c37de936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:44.904646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad35d5-5319-4ebc-aa56-03c3c37de936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:44.906543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad35d5-5319-4ebc-aa56-03c3c37de936 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:44.998975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1299/2562] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:44 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:45.003838 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3f8d9-ff38-45af-8857-6310d96671ca None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:45.014537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3f8d9-ff38-45af-8857-6310d96671ca None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:45.070345 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a710288-8204-46ba-894a-0c8e1c8d21c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:45.071014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a710288-8204-46ba-894a-0c8e1c8d21c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.071216 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a710288-8204-46ba-894a-0c8e1c8d21c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.071491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a710288-8204-46ba-894a-0c8e1c8d21c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.072145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a710288-8204-46ba-894a-0c8e1c8d21c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:45.074148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a710288-8204-46ba-894a-0c8e1c8d21c8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:45.183877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1264/2563] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:45 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:31:45.184864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad35d5-5319-4ebc-aa56-03c3c37de936 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:45.196251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad35d5-5319-4ebc-aa56-03c3c37de936 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:45.203808 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab02b-f8c0-45af-9d01-5ecfdb34ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:45.204694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab02b-f8c0-45af-9d01-5ecfdb34ffb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.204984 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab02b-f8c0-45af-9d01-5ecfdb34ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.205265 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab02b-f8c0-45af-9d01-5ecfdb34ffb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.205923 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fab02b-f8c0-45af-9d01-5ecfdb34ffb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:45.207623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fab02b-f8c0-45af-9d01-5ecfdb34ffb9 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:45.218759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1300/2564] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:31:45.226976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a710288-8204-46ba-894a-0c8e1c8d21c8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:45.237598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a710288-8204-46ba-894a-0c8e1c8d21c8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:45.242651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa1129-ebc0-4102-a78e-e9f7945b3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:45.243255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa1129-ebc0-4102-a78e-e9f7945b3721 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.243537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa1129-ebc0-4102-a78e-e9f7945b3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.243812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa1129-ebc0-4102-a78e-e9f7945b3721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.244525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa1129-ebc0-4102-a78e-e9f7945b3721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:45.246133 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa1129-ebc0-4102-a78e-e9f7945b3721 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:45.256766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1265/2565] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:45.261293 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab02b-f8c0-45af-9d01-5ecfdb34ffb9 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:45.271368 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab02b-f8c0-45af-9d01-5ecfdb34ffb9 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:45.276055 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d6575-5a49-4e53-b4bb-3fc2c076b57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:45.276739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d6575-5a49-4e53-b4bb-3fc2c076b57e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.277023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d6575-5a49-4e53-b4bb-3fc2c076b57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.277297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d6575-5a49-4e53-b4bb-3fc2c076b57e admin admin] PATH_INFO: `/v3/projects/35b190dfd6c841a0b08df26ffc563fdf/users/516183176dd448d38cd7caebf30d9e89/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.291470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d6575-5a49-4e53-b4bb-3fc2c076b57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b190dfd6c841a0b08df26ffc563fdf, user_id=516183176dd448d38cd7caebf30d9e89, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:45.294159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d6575-5a49-4e53-b4bb-3fc2c076b57e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:45.387172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1301/2566] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:45 2022] PUT /identity/v3/projects/35b190dfd6c841a0b08df26ffc563fdf/users/516183176dd448d38cd7caebf30d9e89/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:45.399762 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a446889-0dbc-43f3-991c-5b84ef3c7ce7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.400049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a446889-0dbc-43f3-991c-5b84ef3c7ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.400371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a446889-0dbc-43f3-991c-5b84ef3c7ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.430521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-3a446889-0dbc-43f3-991c-5b84ef3c7ce7 None None] MFA Rules not processed for user `516183176dd448d38cd7caebf30d9e89`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:45.431728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3a446889-0dbc-43f3-991c-5b84ef3c7ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:45.471976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:45.502243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1266/2567] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:45.503526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d6575-5a49-4e53-b4bb-3fc2c076b57e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:45.572251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d6575-5a49-4e53-b4bb-3fc2c076b57e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:45.579323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee635cd-8db5-4fab-bba9-97a82cfb8699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:45.582740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee635cd-8db5-4fab-bba9-97a82cfb8699 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.582740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee635cd-8db5-4fab-bba9-97a82cfb8699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.582740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee635cd-8db5-4fab-bba9-97a82cfb8699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.582740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee635cd-8db5-4fab-bba9-97a82cfb8699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:45.583166 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee635cd-8db5-4fab-bba9-97a82cfb8699 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:45.600106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:45.707840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1302/2568] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:31:45 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:45.711965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a446889-0dbc-43f3-991c-5b84ef3c7ce7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:45.723529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a446889-0dbc-43f3-991c-5b84ef3c7ce7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:45.779029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8a62f-96c6-444b-a3a1-4c5272c2d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:45.779626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8a62f-96c6-444b-a3a1-4c5272c2d5be admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.779899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8a62f-96c6-444b-a3a1-4c5272c2d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.780169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8a62f-96c6-444b-a3a1-4c5272c2d5be admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.780842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8a62f-96c6-444b-a3a1-4c5272c2d5be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:45.783630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8a62f-96c6-444b-a3a1-4c5272c2d5be admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:45.889341 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1267/2569] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:31:45 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:31:45.894119 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee635cd-8db5-4fab-bba9-97a82cfb8699 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:45.904976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee635cd-8db5-4fab-bba9-97a82cfb8699 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:45.910309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bb43-104c-48f0-ac75-c681702651e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:45.910909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bb43-104c-48f0-ac75-c681702651e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.911192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bb43-104c-48f0-ac75-c681702651e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.911467 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921bb43-104c-48f0-ac75-c681702651e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.912116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921bb43-104c-48f0-ac75-c681702651e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:45.913755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921bb43-104c-48f0-ac75-c681702651e4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:45.924282 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1303/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:45.928521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8a62f-96c6-444b-a3a1-4c5272c2d5be admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:45.938528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8a62f-96c6-444b-a3a1-4c5272c2d5be admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:45.943904 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e755ba-53ec-46bd-a7b6-a64e6dc68dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:45.944580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e755ba-53ec-46bd-a7b6-a64e6dc68dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:45.950452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e755ba-53ec-46bd-a7b6-a64e6dc68dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:45.950452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e755ba-53ec-46bd-a7b6-a64e6dc68dc6 admin admin] PATH_INFO: `/v3/projects/0fc6f4d6893a4aa3a7e009d9a285ad51/users/cceb5681beba499c8b2e0bc5f927cc0f/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:45.960459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e755ba-53ec-46bd-a7b6-a64e6dc68dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc6f4d6893a4aa3a7e009d9a285ad51, user_id=cceb5681beba499c8b2e0bc5f927cc0f, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:45.963104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e755ba-53ec-46bd-a7b6-a64e6dc68dc6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:46.014200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1268/2571] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:45 2022] PUT /identity/v3/projects/0fc6f4d6893a4aa3a7e009d9a285ad51/users/cceb5681beba499c8b2e0bc5f927cc0f/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:46.018671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bb43-104c-48f0-ac75-c681702651e4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:46.028660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921bb43-104c-48f0-ac75-c681702651e4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:46.084925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3fbae-a90c-4f69-8c7f-90009ba632d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:46.085522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3fbae-a90c-4f69-8c7f-90009ba632d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:46.085804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3fbae-a90c-4f69-8c7f-90009ba632d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:46.086078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3fbae-a90c-4f69-8c7f-90009ba632d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:46.086717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3fbae-a90c-4f69-8c7f-90009ba632d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:46.088312 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3fbae-a90c-4f69-8c7f-90009ba632d0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:46.098644 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1304/2572] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:31:46.102841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e755ba-53ec-46bd-a7b6-a64e6dc68dc6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:46.113108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e755ba-53ec-46bd-a7b6-a64e6dc68dc6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:46.117716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:46.118364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:46.118647 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:46.118925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] PATH_INFO: `/v3/projects/0fc6f4d6893a4aa3a7e009d9a285ad51/users/cceb5681beba499c8b2e0bc5f927cc0f/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:46.120872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc6f4d6893a4aa3a7e009d9a285ad51, user_id=cceb5681beba499c8b2e0bc5f927cc0f, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:46.123530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:46.134190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1269/2573] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:31:46 2022] PUT /identity/v3/projects/0fc6f4d6893a4aa3a7e009d9a285ad51/users/cceb5681beba499c8b2e0bc5f927cc0f/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:46.144908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562792-4a76-487c-8a7b-c627bfc3d04e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:46.145199 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562792-4a76-487c-8a7b-c627bfc3d04e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:46.145477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562792-4a76-487c-8a7b-c627bfc3d04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:46.173218 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-6a562792-4a76-487c-8a7b-c627bfc3d04e None None] MFA Rules not processed for user `cceb5681beba499c8b2e0bc5f927cc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:46.174574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6a562792-4a76-487c-8a7b-c627bfc3d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:46.246671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1305/2574] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:46.258988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:46.260724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:46.346922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce5206-4952-4e0f-8cc2-bd14bdf7e9fb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:46.350691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:46.351292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:46.351571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:46.351841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:46.364518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:46.424201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:46.425830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:46.435830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1270/2575] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:48.402563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562792-4a76-487c-8a7b-c627bfc3d04e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:48.412242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562792-4a76-487c-8a7b-c627bfc3d04e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:48.415824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264e464-680e-44d7-9f53-be0bb29a1ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:48.416463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e464-680e-44d7-9f53-be0bb29a1ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:48.416743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e464-680e-44d7-9f53-be0bb29a1ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:48.417016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264e464-680e-44d7-9f53-be0bb29a1ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:48.479309 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264e464-680e-44d7-9f53-be0bb29a1ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:48.480782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264e464-680e-44d7-9f53-be0bb29a1ec1 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:48.485947 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:48.490753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1306/2576] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:50.055899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:50.057398 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:50.068631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d29f27-81eb-4ee3-8b32-279534eef29d service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:50.072395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:50.072997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:50.073301 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:50.073574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:50.091769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:50.093410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:50.105090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1271/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:50.289480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc4ed-f471-4297-be97-4422ab33e775 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:50.289978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc4ed-f471-4297-be97-4422ab33e775 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:50.290072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc4ed-f471-4297-be97-4422ab33e775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:50.310125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-347cc4ed-f471-4297-be97-4422ab33e775 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:50.312494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-347cc4ed-f471-4297-be97-4422ab33e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:50.375859 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1307/2578] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:31:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:50.538170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:50.539667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:50.613724 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b453-5da7-42b4-a3d9-62fdf3100e6e service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:50.618908 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44b31-0d9c-4bf2-994f-4f5330c53009 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:50.619508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44b31-0d9c-4bf2-994f-4f5330c53009 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:50.619815 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44b31-0d9c-4bf2-994f-4f5330c53009 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:50.620088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44b31-0d9c-4bf2-994f-4f5330c53009 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:50.628853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44b31-0d9c-4bf2-994f-4f5330c53009 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:50.630434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44b31-0d9c-4bf2-994f-4f5330c53009 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:50.638595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1272/2579] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:31:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:31:51.336484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cc4ed-f471-4297-be97-4422ab33e775 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:51.338822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-347cc4ed-f471-4297-be97-4422ab33e775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:51.440159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cc4ed-f471-4297-be97-4422ab33e775 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:51.459687 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9b343-0e89-47f4-ae96-0658b3aa88d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:51.460259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b343-0e89-47f4-ae96-0658b3aa88d9 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:51.460567 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b343-0e89-47f4-ae96-0658b3aa88d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:51.460857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9b343-0e89-47f4-ae96-0658b3aa88d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:51.469267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a6d9b343-0e89-47f4-ae96-0658b3aa88d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:51.487078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9b343-0e89-47f4-ae96-0658b3aa88d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:51.489002 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9b343-0e89-47f4-ae96-0658b3aa88d9 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:51.504610 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1308/2580] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:55.533334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44b31-0d9c-4bf2-994f-4f5330c53009 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:55.634563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:55.639481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44b31-0d9c-4bf2-994f-4f5330c53009 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:55.646545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:55.647270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:55.647734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:55.647934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] PATH_INFO: `/v3/users/947121da298a401b85a24c076de6962f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:55.649147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947121da298a401b85a24c076de6962f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:55.651937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:55.855667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947121da298a401b85a24c076de6962f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:55.866840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947121da298a401b85a24c076de6962f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:55.957634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947121da298a401b85a24c076de6962f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:55.972448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947121da298a401b85a24c076de6962f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:55.972999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947121da298a401b85a24c076de6962f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:55.986480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1273/2581] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:55 2022] DELETE /identity/v3/users/947121da298a401b85a24c076de6962f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:55.995185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f32260-f042-44b9-8a32-850391a2c4c5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:55.995185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f32260-f042-44b9-8a32-850391a2c4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:55.995185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f32260-f042-44b9-8a32-850391a2c4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:56.029061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-98f32260-f042-44b9-8a32-850391a2c4c5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:56.031271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-98f32260-f042-44b9-8a32-850391a2c4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:56.113439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1309/2582] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:56.120552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:56.122192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:56.217591 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9a8cf-5187-4f19-831a-deebc1e57da3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:56.225816 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacd43a-372c-4126-9a34-7a4702998693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:56.227192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacd43a-372c-4126-9a34-7a4702998693 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:56.227192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacd43a-372c-4126-9a34-7a4702998693 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:56.227370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacd43a-372c-4126-9a34-7a4702998693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:56.245072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacd43a-372c-4126-9a34-7a4702998693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:56.246676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacd43a-372c-4126-9a34-7a4702998693 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:56.260606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1274/2583] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:31:56.749121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f32260-f042-44b9-8a32-850391a2c4c5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:56.752064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-98f32260-f042-44b9-8a32-850391a2c4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:56.770314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f32260-f042-44b9-8a32-850391a2c4c5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:56.776921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:56.777569 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:56.777850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:56.778121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] PATH_INFO: `/v3/projects/038364c423c844738e010d31f3befc59` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:56.779266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=038364c423c844738e010d31f3befc59)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:56.781434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:56.806146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:57.132740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038364c423c844738e010d31f3befc59', 'request_id': 'req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.139164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038364c423c844738e010d31f3befc59', 'request_id': 'req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.145105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038364c423c844738e010d31f3befc59', 'request_id': 'req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.231755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] The token cache is being invalidate because project 038364c423c844738e010d31f3befc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:57.232172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.232840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.234351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1310/2584] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:56 2022] DELETE /identity/v3/projects/038364c423c844738e010d31f3befc59 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:57.238938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacd43a-372c-4126-9a34-7a4702998693 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:57.255529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacd43a-372c-4126-9a34-7a4702998693 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:57.333016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:57.334447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:57.334919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:57.335397 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] PATH_INFO: `/v3/users/516183176dd448d38cd7caebf30d9e89` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:57.336775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516183176dd448d38cd7caebf30d9e89)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:57.338996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:57.351197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:57.596728 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516183176dd448d38cd7caebf30d9e89'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.607797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516183176dd448d38cd7caebf30d9e89'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.690764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516183176dd448d38cd7caebf30d9e89'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.717738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516183176dd448d38cd7caebf30d9e89'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.718493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516183176dd448d38cd7caebf30d9e89'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:57.732156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1275/2585] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:57 2022] DELETE /identity/v3/users/516183176dd448d38cd7caebf30d9e89 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:58.239292 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:58.241019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:58.257305 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e158c-f104-47b9-8bbb-05a6c947d4eb admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:58.290758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:58.295142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:58.365689 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:58.366733 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:58.367330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:58.367828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] PATH_INFO: `/v3/users/583ca8e4a04a498ebde9faeacd8936ca` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:58.369240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=583ca8e4a04a498ebde9faeacd8936ca)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:58.371723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:58.406688 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dfa52-56bb-4e56-8f24-06137b0baad6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:58.416763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:58.418298 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:58.419325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:58.419880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] PATH_INFO: `/v3/projects/35b190dfd6c841a0b08df26ffc563fdf` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:58.421485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b190dfd6c841a0b08df26ffc563fdf)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:58.425331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:58.566692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b190dfd6c841a0b08df26ffc563fdf', 'request_id': 'req-be7c7538-d293-447f-a3a2-3439d622fcb4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.572114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583ca8e4a04a498ebde9faeacd8936ca'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.580924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583ca8e4a04a498ebde9faeacd8936ca'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.594749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583ca8e4a04a498ebde9faeacd8936ca'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.649364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b190dfd6c841a0b08df26ffc563fdf', 'request_id': 'req-be7c7538-d293-447f-a3a2-3439d622fcb4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.658867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b190dfd6c841a0b08df26ffc563fdf', 'request_id': 'req-be7c7538-d293-447f-a3a2-3439d622fcb4'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.671290 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] The token cache is being invalidate because project 35b190dfd6c841a0b08df26ffc563fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:58.676793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.676793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.676793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1276/2586] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:58 2022] DELETE /identity/v3/projects/35b190dfd6c841a0b08df26ffc563fdf => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:31:58.679743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:58.681209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:58.704653 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:58.757891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c7538-d293-447f-a3a2-3439d622fcb4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:58.760469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583ca8e4a04a498ebde9faeacd8936ca'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.761210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-c062ba41-26ee-44e6-92fb-129b6e4fa94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583ca8e4a04a498ebde9faeacd8936ca'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:58.772008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1311/2587] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:58 2022] DELETE /identity/v3/users/583ca8e4a04a498ebde9faeacd8936ca => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:58.773762 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e771e-13b2-43dc-b481-42e6962559b5 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:58.774070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e771e-13b2-43dc-b481-42e6962559b5 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:58.774352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e771e-13b2-43dc-b481-42e6962559b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:58.776235 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:58.777143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:58.777644 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:58.778782 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] PATH_INFO: `/v3/users/cceb5681beba499c8b2e0bc5f927cc0f` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:58.780489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cceb5681beba499c8b2e0bc5f927cc0f)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:58.784530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:58.828630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-265e771e-13b2-43dc-b481-42e6962559b5 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:31:58.828630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-265e771e-13b2-43dc-b481-42e6962559b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:58.857630 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:58.906346 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1312/2588] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:31:58.918084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e771e-13b2-43dc-b481-42e6962559b5 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:58.919532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-265e771e-13b2-43dc-b481-42e6962559b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:58.981283 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e771e-13b2-43dc-b481-42e6962559b5 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:58.986370 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:58.987165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:58.987592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:58.987941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:58.998697 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cceb5681beba499c8b2e0bc5f927cc0f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.002691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:59.004789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:59.006703 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cceb5681beba499c8b2e0bc5f927cc0f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.016934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1313/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:31:59.077793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cceb5681beba499c8b2e0bc5f927cc0f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.094034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cceb5681beba499c8b2e0bc5f927cc0f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.095212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cceb5681beba499c8b2e0bc5f927cc0f'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.108106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1277/2590] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:58 2022] DELETE /identity/v3/users/cceb5681beba499c8b2e0bc5f927cc0f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:59.544039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:59.546519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:59.570543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f0081-eeb7-4c8e-bf8c-ba35e51f63c4 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:31:59.652651 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:31:59.653322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:31:59.653647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:31:59.653925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] PATH_INFO: `/v3/projects/a826cf4183e44db5aa6780dbfb973ef0` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:31:59.655141 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a826cf4183e44db5aa6780dbfb973ef0)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:31:59.657092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:31:59.783792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a826cf4183e44db5aa6780dbfb973ef0', 'request_id': 'req-bb9793aa-bda9-4233-b312-a79d979f0de4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.791411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a826cf4183e44db5aa6780dbfb973ef0', 'request_id': 'req-bb9793aa-bda9-4233-b312-a79d979f0de4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.798547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a826cf4183e44db5aa6780dbfb973ef0', 'request_id': 'req-bb9793aa-bda9-4233-b312-a79d979f0de4'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.803018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:31:59.878914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] The token cache is being invalidate because project a826cf4183e44db5aa6780dbfb973ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:31:59.878914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.879092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:31:59.880371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:59.884111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1314/2591] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:59 2022] DELETE /identity/v3/projects/a826cf4183e44db5aa6780dbfb973ef0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:31:59.885439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:31:59.885937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:59.887419 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:31:59.922461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b00bb6-9ff0-4884-bd79-9db15da9d313 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:00.014565 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9793aa-bda9-4233-b312-a79d979f0de4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:00.025593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:00.026165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:00.026314 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:00.026525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:00.026800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] PATH_INFO: `/v3/projects/0fc6f4d6893a4aa3a7e009d9a285ad51` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:00.027051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:00.027671 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:00.027991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] PATH_INFO: `/v3/users/fdf8f8c3b9b34b4eaa6e45b1a132062b` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:00.028130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc6f4d6893a4aa3a7e009d9a285ad51)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:00.029302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf8f8c3b9b34b4eaa6e45b1a132062b)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:00.030975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:00.032058 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:00.463368 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:00.469239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf8f8c3b9b34b4eaa6e45b1a132062b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.471417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc6f4d6893a4aa3a7e009d9a285ad51', 'request_id': 'req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.477329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf8f8c3b9b34b4eaa6e45b1a132062b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.489904 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf8f8c3b9b34b4eaa6e45b1a132062b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.565117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc6f4d6893a4aa3a7e009d9a285ad51', 'request_id': 'req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.573142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc6f4d6893a4aa3a7e009d9a285ad51', 'request_id': 'req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.586059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] The token cache is being invalidate because project 0fc6f4d6893a4aa3a7e009d9a285ad51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:00.586347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.587198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-af1d5d8d-dd9f-4731-9f20-f0bb755b4f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.594487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1278/2592] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:31:59 2022] DELETE /identity/v3/projects/0fc6f4d6893a4aa3a7e009d9a285ad51 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:00.596994 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd8f77-03dd-416b-9b55-547bde7e7a82 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:00.597440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd8f77-03dd-416b-9b55-547bde7e7a82 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:00.597618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd8f77-03dd-416b-9b55-547bde7e7a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:00.619005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-44fd8f77-03dd-416b-9b55-547bde7e7a82 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:00.620236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-44fd8f77-03dd-416b-9b55-547bde7e7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:00.680421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf8f8c3b9b34b4eaa6e45b1a132062b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.681087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-bb60d6df-522e-4878-b12a-41d712eae1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf8f8c3b9b34b4eaa6e45b1a132062b'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:00.690472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1315/2593] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:31:59 2022] DELETE /identity/v3/users/fdf8f8c3b9b34b4eaa6e45b1a132062b => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:00.698139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1279/2594] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:00.707928 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a0a42-48e2-4332-b62c-dcc61c57a60d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:00.708353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a0a42-48e2-4332-b62c-dcc61c57a60d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:00.708736 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a0a42-48e2-4332-b62c-dcc61c57a60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:00.736801 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-572a0a42-48e2-4332-b62c-dcc61c57a60d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:00.737040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-572a0a42-48e2-4332-b62c-dcc61c57a60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:00.830369 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1316/2595] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:00.831905 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd8f77-03dd-416b-9b55-547bde7e7a82 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:00.847311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd8f77-03dd-416b-9b55-547bde7e7a82 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:00.854325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:00.854325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:00.854325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:00.854325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:00.854757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:00.854757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:00.855758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:00.870257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1280/2596] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:00.874951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a0a42-48e2-4332-b62c-dcc61c57a60d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:00.888144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a0a42-48e2-4332-b62c-dcc61c57a60d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:00.895903 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:00.896551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:00.896840 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:00.897118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:00.897776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:00.899783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:00.924822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:01.003306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1317/2597] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:00 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:01.007870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.029404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70124f61-cd89-416b-96c0-e96df7199c38 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.110197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb3f00-393e-47a5-8557-b855ab0c0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.111734 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3f00-393e-47a5-8557-b855ab0c0730 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.112010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3f00-393e-47a5-8557-b855ab0c0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.112279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3f00-393e-47a5-8557-b855ab0c0730 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.112956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb3f00-393e-47a5-8557-b855ab0c0730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:01.114890 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb3f00-393e-47a5-8557-b855ab0c0730 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:01.212616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.213650 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:01.216329 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1281/2598] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:01 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:01.217294 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb3f00-393e-47a5-8557-b855ab0c0730 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.257027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb3f00-393e-47a5-8557-b855ab0c0730 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.262006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9624443-df32-4983-b5c0-485c7ffeeaaf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.269946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2e5b-9f65-4fdf-b590-f67e6135ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.296991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2e5b-9f65-4fdf-b590-f67e6135ee2a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.296991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2e5b-9f65-4fdf-b590-f67e6135ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.296991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d2e5b-9f65-4fdf-b590-f67e6135ee2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.297574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.297718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d2e5b-9f65-4fdf-b590-f67e6135ee2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:01.297881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.297881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.297881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] PATH_INFO: `/v3/projects/463f240612f749ea9edf19177ce81291` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.297881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=463f240612f749ea9edf19177ce81291)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:01.298758 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d2e5b-9f65-4fdf-b590-f67e6135ee2a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:01.298852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:01.298948 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1282/2599] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:01.300911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2e5b-9f65-4fdf-b590-f67e6135ee2a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.313318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d2e5b-9f65-4fdf-b590-f67e6135ee2a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.319900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4343-442a-46c9-9bf1-57670430772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.320972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4343-442a-46c9-9bf1-57670430772a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.321344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4343-442a-46c9-9bf1-57670430772a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.321634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4343-442a-46c9-9bf1-57670430772a admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.322330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad4343-442a-46c9-9bf1-57670430772a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:01.324165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad4343-442a-46c9-9bf1-57670430772a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:01.335776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1283/2600] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:01.339649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4343-442a-46c9-9bf1-57670430772a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.350512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4343-442a-46c9-9bf1-57670430772a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.355696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ea673-b75f-4965-af81-fae1695bdedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.356412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ea673-b75f-4965-af81-fae1695bdedc admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.356757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ea673-b75f-4965-af81-fae1695bdedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.356951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ea673-b75f-4965-af81-fae1695bdedc admin admin] PATH_INFO: `/v3/projects/896f7f8289db41d6b099234ca9bdc6f2/users/d921e9b4df9c439b96140821d1078e5e/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.372513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ea673-b75f-4965-af81-fae1695bdedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=896f7f8289db41d6b099234ca9bdc6f2, user_id=d921e9b4df9c439b96140821d1078e5e, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:01.378340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ea673-b75f-4965-af81-fae1695bdedc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:01.449291 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:01.457999 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1284/2601] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:01 2022] PUT /identity/v3/projects/896f7f8289db41d6b099234ca9bdc6f2/users/d921e9b4df9c439b96140821d1078e5e/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:32:01.464967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463f240612f749ea9edf19177ce81291', 'request_id': 'req-ea0340c5-9d24-4bc2-9964-cfeac6370a67'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:01.470555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335ba2-7178-4870-b01f-31e2ec85d71d None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.471008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335ba2-7178-4870-b01f-31e2ec85d71d None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.471431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335ba2-7178-4870-b01f-31e2ec85d71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.472147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463f240612f749ea9edf19177ce81291', 'request_id': 'req-ea0340c5-9d24-4bc2-9964-cfeac6370a67'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:01.478514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463f240612f749ea9edf19177ce81291', 'request_id': 'req-ea0340c5-9d24-4bc2-9964-cfeac6370a67'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:01.500741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a8335ba2-7178-4870-b01f-31e2ec85d71d None None] MFA Rules not processed for user `d921e9b4df9c439b96140821d1078e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:01.502704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a8335ba2-7178-4870-b01f-31e2ec85d71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:01.567048 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1285/2602] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:01.578083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335ba2-7178-4870-b01f-31e2ec85d71d None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.580148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a8335ba2-7178-4870-b01f-31e2ec85d71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:01.598910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] The token cache is being invalidate because project 463f240612f749ea9edf19177ce81291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:01.598910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:01.600615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ea0340c5-9d24-4bc2-9964-cfeac6370a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:01.602391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1318/2603] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:01 2022] DELETE /identity/v3/projects/463f240612f749ea9edf19177ce81291 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:32:01.608379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc6db-2966-42ee-a7a1-bbff3cdd8b77 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.608925 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc6db-2966-42ee-a7a1-bbff3cdd8b77 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.609434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc6db-2966-42ee-a7a1-bbff3cdd8b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.631739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f34bc6db-2966-42ee-a7a1-bbff3cdd8b77 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:01.633554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f34bc6db-2966-42ee-a7a1-bbff3cdd8b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:01.645181 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8335ba2-7178-4870-b01f-31e2ec85d71d None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.649167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a27c95-2a1a-41be-8a1d-0dcbbd954912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.649777 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a27c95-2a1a-41be-8a1d-0dcbbd954912 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.650167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a27c95-2a1a-41be-8a1d-0dcbbd954912 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.650457 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a27c95-2a1a-41be-8a1d-0dcbbd954912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.653212 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-03a27c95-2a1a-41be-8a1d-0dcbbd954912 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:01.664414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a27c95-2a1a-41be-8a1d-0dcbbd954912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:01.666198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a27c95-2a1a-41be-8a1d-0dcbbd954912 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:01.676911 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1286/2604] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:32:01.695868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1319/2605] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:01.703806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0bd9-a852-498d-b1b0-96829e94e1ff None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.704129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0bd9-a852-498d-b1b0-96829e94e1ff None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.704442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0bd9-a852-498d-b1b0-96829e94e1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.729395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-889d0bd9-a852-498d-b1b0-96829e94e1ff None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:01.731104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-889d0bd9-a852-498d-b1b0-96829e94e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:01.741047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1287/2606] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:01.745564 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc6db-2966-42ee-a7a1-bbff3cdd8b77 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.756085 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc6db-2966-42ee-a7a1-bbff3cdd8b77 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.761217 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.761820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.762097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.762367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.763011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:01.763314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:01.764957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:01.780881 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1320/2607] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:01.781984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d0bd9-a852-498d-b1b0-96829e94e1ff None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.792846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d0bd9-a852-498d-b1b0-96829e94e1ff None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.798499 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b77c1-8d6a-4849-9d9e-b1f2bc8aa1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.799117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b77c1-8d6a-4849-9d9e-b1f2bc8aa1da admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.799388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b77c1-8d6a-4849-9d9e-b1f2bc8aa1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.799659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b77c1-8d6a-4849-9d9e-b1f2bc8aa1da admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.800320 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b77c1-8d6a-4849-9d9e-b1f2bc8aa1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:01.802308 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b77c1-8d6a-4849-9d9e-b1f2bc8aa1da admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:01.924912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1288/2608] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:01 2022] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:01.929278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:01.939796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091437-87dc-4bf2-be6b-5ea1fddc72f0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:01.997087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c88bf-9436-4ebd-b78e-0133fe1a6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:01.997706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c88bf-9436-4ebd-b78e-0133fe1a6384 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:01.997989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c88bf-9436-4ebd-b78e-0133fe1a6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:01.998267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c88bf-9436-4ebd-b78e-0133fe1a6384 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:01.998922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c88bf-9436-4ebd-b78e-0133fe1a6384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:02.002746 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c88bf-9436-4ebd-b78e-0133fe1a6384 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:02.011224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:02.120239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1321/2609] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:01 2022] POST /identity/v3/users => generated 305 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:32:02.124377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b77c1-8d6a-4849-9d9e-b1f2bc8aa1da admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:02.137214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b77c1-8d6a-4849-9d9e-b1f2bc8aa1da admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:02.140539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926436d-b955-4a1e-8e1b-bb54ab6db648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:02.141165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926436d-b955-4a1e-8e1b-bb54ab6db648 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:02.141443 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926436d-b955-4a1e-8e1b-bb54ab6db648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:02.141743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926436d-b955-4a1e-8e1b-bb54ab6db648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:02.142671 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926436d-b955-4a1e-8e1b-bb54ab6db648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:02.144357 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926436d-b955-4a1e-8e1b-bb54ab6db648 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:02.154255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1289/2610] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:02.158944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c88bf-9436-4ebd-b78e-0133fe1a6384 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:02.169019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c88bf-9436-4ebd-b78e-0133fe1a6384 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:02.174371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fc8f4-f011-4372-96f9-7b6c18ef6e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:02.174964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc8f4-f011-4372-96f9-7b6c18ef6e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:02.175246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc8f4-f011-4372-96f9-7b6c18ef6e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:02.175518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc8f4-f011-4372-96f9-7b6c18ef6e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:02.176316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fc8f4-f011-4372-96f9-7b6c18ef6e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:02.178834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fc8f4-f011-4372-96f9-7b6c18ef6e5d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:02.189231 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1322/2611] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:02.193856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926436d-b955-4a1e-8e1b-bb54ab6db648 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:02.204062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926436d-b955-4a1e-8e1b-bb54ab6db648 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:02.208752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420092e7-b0ac-484a-a0b7-e5eb34f52d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:02.209448 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420092e7-b0ac-484a-a0b7-e5eb34f52d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:02.209731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420092e7-b0ac-484a-a0b7-e5eb34f52d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:02.210022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420092e7-b0ac-484a-a0b7-e5eb34f52d9b admin admin] PATH_INFO: `/v3/projects/e514f1b6a22b46c58dd268d268a9ba28/users/b808fee017b34942bacc6d84165be6e6/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:02.226620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420092e7-b0ac-484a-a0b7-e5eb34f52d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e514f1b6a22b46c58dd268d268a9ba28, user_id=b808fee017b34942bacc6d84165be6e6, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:02.229382 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420092e7-b0ac-484a-a0b7-e5eb34f52d9b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:02.309802 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1290/2612] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:02 2022] PUT /identity/v3/projects/e514f1b6a22b46c58dd268d268a9ba28/users/b808fee017b34942bacc6d84165be6e6/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:02.320773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f3c8-a104-40b2-b7ea-ba1d006851ec None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:02.321023 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f3c8-a104-40b2-b7ea-ba1d006851ec None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:02.321427 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f3c8-a104-40b2-b7ea-ba1d006851ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:02.362054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-67f1f3c8-a104-40b2-b7ea-ba1d006851ec None None] MFA Rules not processed for user `b808fee017b34942bacc6d84165be6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:02.363289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-67f1f3c8-a104-40b2-b7ea-ba1d006851ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:02.441855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1323/2613] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:02 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:02.446509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420092e7-b0ac-484a-a0b7-e5eb34f52d9b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:02.484312 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:02.520822 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420092e7-b0ac-484a-a0b7-e5eb34f52d9b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:02.525746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5234-786a-4b2e-aa35-5c6db7a643f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:02.526387 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5234-786a-4b2e-aa35-5c6db7a643f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:02.526672 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5234-786a-4b2e-aa35-5c6db7a643f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:02.526949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5234-786a-4b2e-aa35-5c6db7a643f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:02.527738 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5234-786a-4b2e-aa35-5c6db7a643f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:02.529773 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5234-786a-4b2e-aa35-5c6db7a643f3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:02.648270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1291/2614] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:02 2022] POST /identity/v3/projects => generated 405 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:02.649522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1f3c8-a104-40b2-b7ea-ba1d006851ec None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:02.661168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1f3c8-a104-40b2-b7ea-ba1d006851ec None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:02.724866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f670fe-d3a5-48a3-9e39-2a7e4688dc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:02.725521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f670fe-d3a5-48a3-9e39-2a7e4688dc9b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:02.725806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f670fe-d3a5-48a3-9e39-2a7e4688dc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:02.726080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f670fe-d3a5-48a3-9e39-2a7e4688dc9b admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:02.726742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f670fe-d3a5-48a3-9e39-2a7e4688dc9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:02.728737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f670fe-d3a5-48a3-9e39-2a7e4688dc9b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:02.826952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1324/2615] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:02 2022] POST /identity/v3/users => generated 309 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:02.828686 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5234-786a-4b2e-aa35-5c6db7a643f3 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:02.841402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5234-786a-4b2e-aa35-5c6db7a643f3 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:02.848203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1371fc9-06fe-41a0-8fe4-5d142c2f84c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:02.848878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1371fc9-06fe-41a0-8fe4-5d142c2f84c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:02.849172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1371fc9-06fe-41a0-8fe4-5d142c2f84c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:02.849432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1371fc9-06fe-41a0-8fe4-5d142c2f84c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:02.850128 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1371fc9-06fe-41a0-8fe4-5d142c2f84c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:02.851766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1371fc9-06fe-41a0-8fe4-5d142c2f84c4 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:02.863969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1292/2616] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:02.868434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f670fe-d3a5-48a3-9e39-2a7e4688dc9b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:02.879350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f670fe-d3a5-48a3-9e39-2a7e4688dc9b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:02.884773 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de241f-2e35-49ab-991a-fc1fa9d739b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:02.885594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de241f-2e35-49ab-991a-fc1fa9d739b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:02.885880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de241f-2e35-49ab-991a-fc1fa9d739b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:02.886158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de241f-2e35-49ab-991a-fc1fa9d739b0 admin admin] PATH_INFO: `/v3/projects/0e78400610de4c9c906c2b13bf4b7489/users/cee5bfc7cbbf434fbea1d6b7967c781a/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:02.903165 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de241f-2e35-49ab-991a-fc1fa9d739b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e78400610de4c9c906c2b13bf4b7489, user_id=cee5bfc7cbbf434fbea1d6b7967c781a, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:02.906057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de241f-2e35-49ab-991a-fc1fa9d739b0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:02.981500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1325/2617] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:02 2022] PUT /identity/v3/projects/0e78400610de4c9c906c2b13bf4b7489/users/cee5bfc7cbbf434fbea1d6b7967c781a/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:02.986569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1371fc9-06fe-41a0-8fe4-5d142c2f84c4 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:02.997739 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1371fc9-06fe-41a0-8fe4-5d142c2f84c4 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:03.059471 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d799826-49ff-483e-9054-71514d6b92a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:03.060074 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d799826-49ff-483e-9054-71514d6b92a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:03.060377 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d799826-49ff-483e-9054-71514d6b92a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:03.060649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d799826-49ff-483e-9054-71514d6b92a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:03.061294 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d799826-49ff-483e-9054-71514d6b92a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:03.062896 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d799826-49ff-483e-9054-71514d6b92a3 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:03.077085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1293/2618] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:03.078338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de241f-2e35-49ab-991a-fc1fa9d739b0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:03.090258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de241f-2e35-49ab-991a-fc1fa9d739b0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:03.095810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:03.096518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:03.096804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:03.097123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] PATH_INFO: `/v3/projects/0e78400610de4c9c906c2b13bf4b7489/users/cee5bfc7cbbf434fbea1d6b7967c781a/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:03.099037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e78400610de4c9c906c2b13bf4b7489, user_id=cee5bfc7cbbf434fbea1d6b7967c781a, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:03.101726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:03.114729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1326/2619] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:03 2022] PUT /identity/v3/projects/0e78400610de4c9c906c2b13bf4b7489/users/cee5bfc7cbbf434fbea1d6b7967c781a/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:03.124926 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdf804-4643-4483-b726-037eec042ba5 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:03.125440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdf804-4643-4483-b726-037eec042ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:03.125440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdf804-4643-4483-b726-037eec042ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:03.154240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-10bdf804-4643-4483-b726-037eec042ba5 None None] MFA Rules not processed for user `cee5bfc7cbbf434fbea1d6b7967c781a`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:03.155388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-10bdf804-4643-4483-b726-037eec042ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:03.226602 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1294/2620] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:03.239573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:03.241811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:03.270377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:03.300544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f83f93-9d1f-4f24-860d-05af64fa7e2d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:03.304272 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:03.306094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:03.306094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:03.306094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:03.314540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:03.315960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:03.325887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1327/2621] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:03 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:03.674014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdf804-4643-4483-b726-037eec042ba5 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:03.675349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-10bdf804-4643-4483-b726-037eec042ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:03.687459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdf804-4643-4483-b726-037eec042ba5 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:03.691984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9fe63-3938-4534-b87d-d940066355df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:03.692626 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9fe63-3938-4534-b87d-d940066355df service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:03.692956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9fe63-3938-4534-b87d-d940066355df service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:03.693217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9fe63-3938-4534-b87d-d940066355df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:03.717167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:03.761947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9fe63-3938-4534-b87d-d940066355df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:03.763546 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9fe63-3938-4534-b87d-d940066355df service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:03.773584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1295/2622] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:03 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:04.795308 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:04.796763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:04.863404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a7077-a28b-437b-a1a5-376330b7cfec service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:04.867982 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:04.868676 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:04.868960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:04.873176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] PATH_INFO: `/v3/users/d921e9b4df9c439b96140821d1078e5e` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:04.873176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d921e9b4df9c439b96140821d1078e5e)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:04.873176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:05.077225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd921e9b4df9c439b96140821d1078e5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:05.084702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd921e9b4df9c439b96140821d1078e5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:05.096934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd921e9b4df9c439b96140821d1078e5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:05.211735 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd921e9b4df9c439b96140821d1078e5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:05.212417 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd921e9b4df9c439b96140821d1078e5e'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:05.218814 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1328/2623] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:04 2022] DELETE /identity/v3/users/d921e9b4df9c439b96140821d1078e5e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:05.223532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43bd6e-2f37-4d04-a7c7-059625bea1fe None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:05.224040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43bd6e-2f37-4d04-a7c7-059625bea1fe None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:05.224139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43bd6e-2f37-4d04-a7c7-059625bea1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:05.242693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-cd43bd6e-2f37-4d04-a7c7-059625bea1fe None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:05.243820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cd43bd6e-2f37-4d04-a7c7-059625bea1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:05.305064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1296/2624] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:05.315855 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:05.317383 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:05.378413 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:05.384238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a38e0-713c-4ac7-baae-98bd5bae229c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:05.387952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de261bc-51a9-451b-bcd3-bf7cd0798506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:05.388599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de261bc-51a9-451b-bcd3-bf7cd0798506 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:05.388882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de261bc-51a9-451b-bcd3-bf7cd0798506 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:05.389160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de261bc-51a9-451b-bcd3-bf7cd0798506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:05.399635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de261bc-51a9-451b-bcd3-bf7cd0798506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:05.400939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de261bc-51a9-451b-bcd3-bf7cd0798506 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:05.412466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1329/2625] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:05.893288 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43bd6e-2f37-4d04-a7c7-059625bea1fe None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:05.894529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cd43bd6e-2f37-4d04-a7c7-059625bea1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:05.906665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43bd6e-2f37-4d04-a7c7-059625bea1fe None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:05.914245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:05.915060 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:05.915346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:05.915779 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] PATH_INFO: `/v3/projects/896f7f8289db41d6b099234ca9bdc6f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:05.917323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] RBAC: Authorizing `identity:delete_project(project_id=896f7f8289db41d6b099234ca9bdc6f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:05.919081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:06.078118 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896f7f8289db41d6b099234ca9bdc6f2', 'request_id': 'req-121bd81e-f624-42a8-8709-161b6aaf225a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:06.160424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896f7f8289db41d6b099234ca9bdc6f2', 'request_id': 'req-121bd81e-f624-42a8-8709-161b6aaf225a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:06.168021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896f7f8289db41d6b099234ca9bdc6f2', 'request_id': 'req-121bd81e-f624-42a8-8709-161b6aaf225a'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:06.180950 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] The token cache is being invalidate because project 896f7f8289db41d6b099234ca9bdc6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:06.181249 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:06.182003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-121bd81e-f624-42a8-8709-161b6aaf225a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:06.183496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1297/2626] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:05 2022] DELETE /identity/v3/projects/896f7f8289db41d6b099234ca9bdc6f2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:06.188746 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc22a1e-fc11-4798-8dd3-855bc2816858 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.189461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc22a1e-fc11-4798-8dd3-855bc2816858 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.189461 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc22a1e-fc11-4798-8dd3-855bc2816858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.210072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-2fc22a1e-fc11-4798-8dd3-855bc2816858 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:06.211376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-2fc22a1e-fc11-4798-8dd3-855bc2816858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:06.273628 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1330/2627] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:06.281600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566a6f-79c1-44e3-9452-1bc25e81cccb None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.282711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566a6f-79c1-44e3-9452-1bc25e81cccb None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.282835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566a6f-79c1-44e3-9452-1bc25e81cccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.304971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ef566a6f-79c1-44e3-9452-1bc25e81cccb None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:06.306169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ef566a6f-79c1-44e3-9452-1bc25e81cccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:06.314452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1298/2628] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:06.318983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc22a1e-fc11-4798-8dd3-855bc2816858 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:06.329828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc22a1e-fc11-4798-8dd3-855bc2816858 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:06.334761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:06.335372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.335719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.335988 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.336716 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:06.337025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:06.338683 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:06.351515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1331/2629] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:06.357365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef566a6f-79c1-44e3-9452-1bc25e81cccb None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:06.366707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef566a6f-79c1-44e3-9452-1bc25e81cccb None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:06.371750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfd866-69b1-4356-900f-18ea3fb20f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:06.372391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfd866-69b1-4356-900f-18ea3fb20f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.372692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfd866-69b1-4356-900f-18ea3fb20f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.372961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfd866-69b1-4356-900f-18ea3fb20f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.373608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfd866-69b1-4356-900f-18ea3fb20f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:06.375554 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfd866-69b1-4356-900f-18ea3fb20f2e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:06.493680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1299/2630] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:06 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:06.497755 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:06.508957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701e47f-55c1-4041-82f3-8bd3c58e95a1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:06.567146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764208c0-e9e9-4f4c-b4a7-6c770e54edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:06.567679 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764208c0-e9e9-4f4c-b4a7-6c770e54edaf admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.567962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764208c0-e9e9-4f4c-b4a7-6c770e54edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.568239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764208c0-e9e9-4f4c-b4a7-6c770e54edaf admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.568921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764208c0-e9e9-4f4c-b4a7-6c770e54edaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:06.570838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764208c0-e9e9-4f4c-b4a7-6c770e54edaf admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:06.651501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1332/2631] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:06 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:06.655768 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfd866-69b1-4356-900f-18ea3fb20f2e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:06.666355 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfd866-69b1-4356-900f-18ea3fb20f2e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:06.671157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2bf2b-07a8-4942-b6b2-7103492c7901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:06.671760 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bf2b-07a8-4942-b6b2-7103492c7901 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.672045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bf2b-07a8-4942-b6b2-7103492c7901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.672351 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2bf2b-07a8-4942-b6b2-7103492c7901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.673080 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2bf2b-07a8-4942-b6b2-7103492c7901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:06.674687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2bf2b-07a8-4942-b6b2-7103492c7901 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:06.684974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1300/2632] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:06.689352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764208c0-e9e9-4f4c-b4a7-6c770e54edaf admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:06.699490 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764208c0-e9e9-4f4c-b4a7-6c770e54edaf admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:06.704901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28188967-78a8-4bac-b739-7868410dbcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:06.705500 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28188967-78a8-4bac-b739-7868410dbcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.705784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28188967-78a8-4bac-b739-7868410dbcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.706060 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28188967-78a8-4bac-b739-7868410dbcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.706708 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28188967-78a8-4bac-b739-7868410dbcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:06.708357 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28188967-78a8-4bac-b739-7868410dbcf7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:06.720086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1333/2633] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:06.724170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2bf2b-07a8-4942-b6b2-7103492c7901 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:06.730832 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:06.734569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2bf2b-07a8-4942-b6b2-7103492c7901 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:06.739935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:06.740719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.742079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.742079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] PATH_INFO: `/v3/projects/0483cf8ce4eb438a8c517bc27526d6f2/users/a9bbe5c96ea3479288e3557d0f1bfcc2/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.756857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0483cf8ce4eb438a8c517bc27526d6f2, user_id=a9bbe5c96ea3479288e3557d0f1bfcc2, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:06.759857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:06.848904 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1301/2634] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:06 2022] PUT /identity/v3/projects/0483cf8ce4eb438a8c517bc27526d6f2/users/a9bbe5c96ea3479288e3557d0f1bfcc2/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:06.858996 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75b52-85c5-493f-af33-bd3553788aa2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:06.859280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75b52-85c5-493f-af33-bd3553788aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:06.859553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75b52-85c5-493f-af33-bd3553788aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:06.888404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8dc75b52-85c5-493f-af33-bd3553788aa2 None None] MFA Rules not processed for user `a9bbe5c96ea3479288e3557d0f1bfcc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:06.889594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8dc75b52-85c5-493f-af33-bd3553788aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:06.932849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:06.953699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1334/2635] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:06.964493 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:06.966185 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:07.024365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17733f-a013-4854-8002-2fe8c91ecd08 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:07.028092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ec6ff-29bd-4eb4-bebd-883195dd9e5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:07.028741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ec6ff-29bd-4eb4-bebd-883195dd9e5f service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:07.029019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ec6ff-29bd-4eb4-bebd-883195dd9e5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:07.029290 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ec6ff-29bd-4eb4-bebd-883195dd9e5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:07.038588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ec6ff-29bd-4eb4-bebd-883195dd9e5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:07.040252 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ec6ff-29bd-4eb4-bebd-883195dd9e5f service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:07.050057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1302/2636] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:08.183066 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b57d0-aa7e-4c1c-b07d-a22f54d2f08d None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.183601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b57d0-aa7e-4c1c-b07d-a22f54d2f08d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.183854 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b57d0-aa7e-4c1c-b07d-a22f54d2f08d None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.185519 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1335/2637] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:32:08.192010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1e1d-c1ec-431b-928c-3c5bf7d087db None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.192503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1e1d-c1ec-431b-928c-3c5bf7d087db None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.192698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1e1d-c1ec-431b-928c-3c5bf7d087db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.215539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-906c1e1d-c1ec-431b-928c-3c5bf7d087db None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:08.216799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-906c1e1d-c1ec-431b-928c-3c5bf7d087db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:08.285140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1303/2638] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:32:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:08.296869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b57d0-aa7e-4c1c-b07d-a22f54d2f08d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:08.298549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad1b57d0-aa7e-4c1c-b07d-a22f54d2f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:08.356482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b57d0-aa7e-4c1c-b07d-a22f54d2f08d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:08.360091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dccc19-4ac0-4662-8109-8498a207c60b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00283447a1a6405b952e541a13c91110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:08.360718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dccc19-4ac0-4662-8109-8498a207c60b service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.361039 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dccc19-4ac0-4662-8109-8498a207c60b service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.361354 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dccc19-4ac0-4662-8109-8498a207c60b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.371842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dccc19-4ac0-4662-8109-8498a207c60b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:08.373324 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dccc19-4ac0-4662-8109-8498a207c60b service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:08.384942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1336/2639] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:08.609964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb495dc-8204-49e5-8c70-3db58b1d8759 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.610248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb495dc-8204-49e5-8c70-3db58b1d8759 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.610525 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb495dc-8204-49e5-8c70-3db58b1d8759 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.612933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1304/2640] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:32:08.617297 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65c40-979c-4ca5-84a7-43904b1ce269 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.617592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65c40-979c-4ca5-84a7-43904b1ce269 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.617869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def65c40-979c-4ca5-84a7-43904b1ce269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.638059 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-def65c40-979c-4ca5-84a7-43904b1ce269 None None] MFA Rules not processed for user `757ad5baa909451d94dd1eced0407d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:08.641191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-def65c40-979c-4ca5-84a7-43904b1ce269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:08.691057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1337/2641] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:32:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:08.702732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb495dc-8204-49e5-8c70-3db58b1d8759 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:08.704462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-0eb495dc-8204-49e5-8c70-3db58b1d8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:08.717669 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb495dc-8204-49e5-8c70-3db58b1d8759 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:08.721257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46da8f1-ad32-4b27-953b-4fb1ef2262b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:08.722511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da8f1-ad32-4b27-953b-4fb1ef2262b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.722798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da8f1-ad32-4b27-953b-4fb1ef2262b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.723065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da8f1-ad32-4b27-953b-4fb1ef2262b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.730603 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46da8f1-ad32-4b27-953b-4fb1ef2262b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:08.732231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46da8f1-ad32-4b27-953b-4fb1ef2262b8 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:08.740778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1305/2642] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:08.824228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a42c-3cd2-4a85-aefc-f0e8dad66bca None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.824645 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a42c-3cd2-4a85-aefc-f0e8dad66bca None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.825001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8a42c-3cd2-4a85-aefc-f0e8dad66bca None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.826579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1338/2643] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:32:08.836627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b88c6a-8d9b-4a36-806c-1b434eeb2aae None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.837359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b88c6a-8d9b-4a36-806c-1b434eeb2aae None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.837642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b88c6a-8d9b-4a36-806c-1b434eeb2aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.857691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e7b88c6a-8d9b-4a36-806c-1b434eeb2aae None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:08.858883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e7b88c6a-8d9b-4a36-806c-1b434eeb2aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:08.869197 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1306/2644] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:32:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:08.879627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a42c-3cd2-4a85-aefc-f0e8dad66bca None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:08.881341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7fb8a42c-3cd2-4a85-aefc-f0e8dad66bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:08.894864 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8a42c-3cd2-4a85-aefc-f0e8dad66bca None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:08.898476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4634d4f-4c60-457c-ae6f-f1f5f855c925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:08.899068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634d4f-4c60-457c-ae6f-f1f5f855c925 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:08.899350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634d4f-4c60-457c-ae6f-f1f5f855c925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:08.899627 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634d4f-4c60-457c-ae6f-f1f5f855c925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:08.910132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4634d4f-4c60-457c-ae6f-f1f5f855c925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:08.911574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4634d4f-4c60-457c-ae6f-f1f5f855c925 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:08.922422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1339/2645] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:11.376020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b88c6a-8d9b-4a36-806c-1b434eeb2aae None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:11.377450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e7b88c6a-8d9b-4a36-806c-1b434eeb2aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:11.437939 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:11.444002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b88c6a-8d9b-4a36-806c-1b434eeb2aae None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:11.448559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:11.451025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:11.451025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:11.451025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] PATH_INFO: `/v3/users/b808fee017b34942bacc6d84165be6e6` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:11.451025 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b808fee017b34942bacc6d84165be6e6)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:11.452797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:11.645856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b808fee017b34942bacc6d84165be6e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:11.653755 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b808fee017b34942bacc6d84165be6e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:11.717497 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b808fee017b34942bacc6d84165be6e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:11.734929 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b808fee017b34942bacc6d84165be6e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:11.735938 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b808fee017b34942bacc6d84165be6e6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:11.743798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1307/2646] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:11 2022] DELETE /identity/v3/users/b808fee017b34942bacc6d84165be6e6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:11.748499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce88ab-a8e0-4850-898e-d90b07cea509 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:11.749094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce88ab-a8e0-4850-898e-d90b07cea509 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:11.749094 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce88ab-a8e0-4850-898e-d90b07cea509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:11.773160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-e4ce88ab-a8e0-4850-898e-d90b07cea509 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:11.774807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4ce88ab-a8e0-4850-898e-d90b07cea509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:11.848202 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1340/2647] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:11.857778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:11.859340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:11.926848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f03d8d-4cf5-4f99-9fb1-2d1679cabc2d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:11.930581 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacecffc-5071-43f6-ac40-a54a9bad752f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:11.931191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacecffc-5071-43f6-ac40-a54a9bad752f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:11.931485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacecffc-5071-43f6-ac40-a54a9bad752f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:11.931859 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacecffc-5071-43f6-ac40-a54a9bad752f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:11.942271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacecffc-5071-43f6-ac40-a54a9bad752f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:11.943776 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacecffc-5071-43f6-ac40-a54a9bad752f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:11.954648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1308/2648] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:12.376079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce88ab-a8e0-4850-898e-d90b07cea509 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:12.377626 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e4ce88ab-a8e0-4850-898e-d90b07cea509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:12.394562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce88ab-a8e0-4850-898e-d90b07cea509 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:12.406973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:12.407909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:12.408289 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:12.408620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] PATH_INFO: `/v3/projects/e514f1b6a22b46c58dd268d268a9ba28` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:12.411030 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e514f1b6a22b46c58dd268d268a9ba28)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:12.413113 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:12.436548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:12.546967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e514f1b6a22b46c58dd268d268a9ba28', 'request_id': 'req-f83ee7da-496f-4fd0-b318-52203dda4954'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:12.554978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e514f1b6a22b46c58dd268d268a9ba28', 'request_id': 'req-f83ee7da-496f-4fd0-b318-52203dda4954'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:12.561212 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e514f1b6a22b46c58dd268d268a9ba28', 'request_id': 'req-f83ee7da-496f-4fd0-b318-52203dda4954'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:12.564512 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb151-bdc0-4651-8d6f-d1795aa0eebc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:12.564960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb151-bdc0-4651-8d6f-d1795aa0eebc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:12.565072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb151-bdc0-4651-8d6f-d1795aa0eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:12.583824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-6becb151-bdc0-4651-8d6f-d1795aa0eebc None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:12.585084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6becb151-bdc0-4651-8d6f-d1795aa0eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:12.640656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1309/2649] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:32:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:12.653269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becb151-bdc0-4651-8d6f-d1795aa0eebc None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:12.654394 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6becb151-bdc0-4651-8d6f-d1795aa0eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:12.677769 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] The token cache is being invalidate because project e514f1b6a22b46c58dd268d268a9ba28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:12.678046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:12.678694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:12.680209 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1341/2650] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:12 2022] DELETE /identity/v3/projects/e514f1b6a22b46c58dd268d268a9ba28 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:32:12.683201 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:12.684238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:12.685536 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:12.727587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becb151-bdc0-4651-8d6f-d1795aa0eebc None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:12.733408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:12.734193 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:12.734473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:12.734804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:12.736673 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:12.748467 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:12.750064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:12.759422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1310/2651] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:32:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 10:32:12.762177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ee7da-496f-4fd0-b318-52203dda4954 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:12.766938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:12.767571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:12.767851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:12.768127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] PATH_INFO: `/v3/users/cee5bfc7cbbf434fbea1d6b7967c781a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:12.769351 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee5bfc7cbbf434fbea1d6b7967c781a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:12.771396 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:12.981372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee5bfc7cbbf434fbea1d6b7967c781a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:12.994187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee5bfc7cbbf434fbea1d6b7967c781a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:13.013122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee5bfc7cbbf434fbea1d6b7967c781a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:13.094922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee5bfc7cbbf434fbea1d6b7967c781a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:13.096153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5616d6ed-535f-4074-8575-2c9fa6c919ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee5bfc7cbbf434fbea1d6b7967c781a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:13.108127 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1342/2652] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:12 2022] DELETE /identity/v3/users/cee5bfc7cbbf434fbea1d6b7967c781a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:32:13.654704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:13.670305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7ffac-9efc-4f82-b46a-ae737b939ded service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:13.786318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:13.786952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:13.787228 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:13.787503 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] PATH_INFO: `/v3/projects/0e78400610de4c9c906c2b13bf4b7489` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:13.788862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e78400610de4c9c906c2b13bf4b7489)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:13.790870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:13.941614 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e78400610de4c9c906c2b13bf4b7489', 'request_id': 'req-500d5b35-65a7-4ae4-b03c-ce39a32f6020'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:14.046156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e78400610de4c9c906c2b13bf4b7489', 'request_id': 'req-500d5b35-65a7-4ae4-b03c-ce39a32f6020'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:14.067229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e78400610de4c9c906c2b13bf4b7489', 'request_id': 'req-500d5b35-65a7-4ae4-b03c-ce39a32f6020'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:14.099446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] The token cache is being invalidate because project 0e78400610de4c9c906c2b13bf4b7489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:14.100459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:14.101794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-500d5b35-65a7-4ae4-b03c-ce39a32f6020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:14.104155 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1311/2653] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:13 2022] DELETE /identity/v3/projects/0e78400610de4c9c906c2b13bf4b7489 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:14.109360 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14187a3-7c6d-4050-bc82-1bd32985bec8 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.110348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14187a3-7c6d-4050-bc82-1bd32985bec8 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.110634 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14187a3-7c6d-4050-bc82-1bd32985bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:14.141787 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f14187a3-7c6d-4050-bc82-1bd32985bec8 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:14.143266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f14187a3-7c6d-4050-bc82-1bd32985bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:14.183081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:14.259484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1343/2654] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:14.270613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc850f-fddd-42ed-afb0-e30739ef5d69 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.271433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc850f-fddd-42ed-afb0-e30739ef5d69 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.271959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc850f-fddd-42ed-afb0-e30739ef5d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:14.299269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-30fc850f-fddd-42ed-afb0-e30739ef5d69 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:14.301243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-30fc850f-fddd-42ed-afb0-e30739ef5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:14.318296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1312/2655] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:14.321200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14187a3-7c6d-4050-bc82-1bd32985bec8 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:14.332347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14187a3-7c6d-4050-bc82-1bd32985bec8 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:14.338889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:14.339806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.340267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.342253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:14.342253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:14.342253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:14.345563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:14.374661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1344/2656] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:14.379190 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc850f-fddd-42ed-afb0-e30739ef5d69 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:14.390240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc850f-fddd-42ed-afb0-e30739ef5d69 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:14.395652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb169-f576-440a-836b-307ba4b3cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:14.396272 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb169-f576-440a-836b-307ba4b3cbcd admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.396652 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb169-f576-440a-836b-307ba4b3cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.396872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fb169-f576-440a-836b-307ba4b3cbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:14.397530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fb169-f576-440a-836b-307ba4b3cbcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:14.399458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fb169-f576-440a-836b-307ba4b3cbcd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:14.546300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1313/2657] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:14 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:14.551130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:14.562024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafe1c3-1cc9-4f13-b4d0-f9c51f79237f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:14.624921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6dac2-2486-4e2a-9ff6-802cc09ccf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:14.625527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6dac2-2486-4e2a-9ff6-802cc09ccf72 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.625809 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6dac2-2486-4e2a-9ff6-802cc09ccf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.626083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6dac2-2486-4e2a-9ff6-802cc09ccf72 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:14.626734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6dac2-2486-4e2a-9ff6-802cc09ccf72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:14.629267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6dac2-2486-4e2a-9ff6-802cc09ccf72 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:14.741554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1345/2658] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:14 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:14.745634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb169-f576-440a-836b-307ba4b3cbcd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:14.756807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fb169-f576-440a-836b-307ba4b3cbcd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:14.761966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9543b1-f6b1-4010-b690-0b2aad5a4537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:14.762623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9543b1-f6b1-4010-b690-0b2aad5a4537 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.762900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9543b1-f6b1-4010-b690-0b2aad5a4537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.763268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9543b1-f6b1-4010-b690-0b2aad5a4537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:14.764154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9543b1-f6b1-4010-b690-0b2aad5a4537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:14.765799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9543b1-f6b1-4010-b690-0b2aad5a4537 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:14.779899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1314/2659] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:14.781503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6dac2-2486-4e2a-9ff6-802cc09ccf72 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:14.794784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6dac2-2486-4e2a-9ff6-802cc09ccf72 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:14.799436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd2d12-f35f-4c5c-8f76-0113d317ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:14.800142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2d12-f35f-4c5c-8f76-0113d317ddd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.800460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2d12-f35f-4c5c-8f76-0113d317ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.800713 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd2d12-f35f-4c5c-8f76-0113d317ddd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:14.810647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd2d12-f35f-4c5c-8f76-0113d317ddd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:14.812302 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd2d12-f35f-4c5c-8f76-0113d317ddd0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:14.835429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1346/2660] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:14.839609 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9543b1-f6b1-4010-b690-0b2aad5a4537 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:14.844928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:14.850487 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9543b1-f6b1-4010-b690-0b2aad5a4537 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:14.855215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796fd8a-390d-40cd-8290-69865e9413dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:14.855871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796fd8a-390d-40cd-8290-69865e9413dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.856152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796fd8a-390d-40cd-8290-69865e9413dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.856700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796fd8a-390d-40cd-8290-69865e9413dc admin admin] PATH_INFO: `/v3/projects/00204192cdb5467cb0763353828417f0/users/7823fcc19d0d407793641e3e890c1845/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:14.873556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796fd8a-390d-40cd-8290-69865e9413dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=00204192cdb5467cb0763353828417f0, user_id=7823fcc19d0d407793641e3e890c1845, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:14.876453 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796fd8a-390d-40cd-8290-69865e9413dc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:14.964211 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1315/2661] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:14 2022] PUT /identity/v3/projects/00204192cdb5467cb0763353828417f0/users/7823fcc19d0d407793641e3e890c1845/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:14.976271 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c032ce7-8385-47ce-b382-ae48ed2dd271 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:14.976632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c032ce7-8385-47ce-b382-ae48ed2dd271 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:14.976921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c032ce7-8385-47ce-b382-ae48ed2dd271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:15.006849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-8c032ce7-8385-47ce-b382-ae48ed2dd271 None None] MFA Rules not processed for user `7823fcc19d0d407793641e3e890c1845`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:15.008254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8c032ce7-8385-47ce-b382-ae48ed2dd271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:15.081566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1347/2662] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:15.086637 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796fd8a-390d-40cd-8290-69865e9413dc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:15.156620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796fd8a-390d-40cd-8290-69865e9413dc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:15.163059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd2ad1-b2bb-4dac-b580-48000f5b35ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:15.163680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd2ad1-b2bb-4dac-b580-48000f5b35ad admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:15.163953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd2ad1-b2bb-4dac-b580-48000f5b35ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:15.164223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd2ad1-b2bb-4dac-b580-48000f5b35ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:15.164900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd2ad1-b2bb-4dac-b580-48000f5b35ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:15.166830 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd2ad1-b2bb-4dac-b580-48000f5b35ad admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:15.267797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1316/2663] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:15 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:32:15.272786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c032ce7-8385-47ce-b382-ae48ed2dd271 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:15.286261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c032ce7-8385-47ce-b382-ae48ed2dd271 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:15.309266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:15.352938 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fefa8-389b-46ad-a558-060d1ba0508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:15.353574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fefa8-389b-46ad-a558-060d1ba0508f admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:15.353861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fefa8-389b-46ad-a558-060d1ba0508f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:15.354288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fefa8-389b-46ad-a558-060d1ba0508f admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:15.354948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fefa8-389b-46ad-a558-060d1ba0508f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:15.356992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fefa8-389b-46ad-a558-060d1ba0508f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:15.458965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1348/2664] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:15 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:15.459285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd2ad1-b2bb-4dac-b580-48000f5b35ad admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:15.471168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd2ad1-b2bb-4dac-b580-48000f5b35ad admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:15.481879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c01b-93bd-4f3f-a654-2ed1419b66a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:15.482498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c01b-93bd-4f3f-a654-2ed1419b66a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:15.482780 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c01b-93bd-4f3f-a654-2ed1419b66a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:15.483052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c01b-93bd-4f3f-a654-2ed1419b66a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:15.483720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314c01b-93bd-4f3f-a654-2ed1419b66a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:15.485404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314c01b-93bd-4f3f-a654-2ed1419b66a6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:15.499121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1317/2665] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:15.503062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fefa8-389b-46ad-a558-060d1ba0508f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:15.525109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fefa8-389b-46ad-a558-060d1ba0508f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:15.529760 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8bbc3-630c-40b6-a812-680199082e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:15.530420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8bbc3-630c-40b6-a812-680199082e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:15.530704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8bbc3-630c-40b6-a812-680199082e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:15.530973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8bbc3-630c-40b6-a812-680199082e9c admin admin] PATH_INFO: `/v3/projects/998b807cbbf2480c899a7a14786cd49c/users/bb507a6432e04fbdbe317c8b0757c140/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:15.549252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8bbc3-630c-40b6-a812-680199082e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=998b807cbbf2480c899a7a14786cd49c, user_id=bb507a6432e04fbdbe317c8b0757c140, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:15.553725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8bbc3-630c-40b6-a812-680199082e9c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:15.624599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1349/2666] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:15 2022] PUT /identity/v3/projects/998b807cbbf2480c899a7a14786cd49c/users/bb507a6432e04fbdbe317c8b0757c140/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:15.630050 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c01b-93bd-4f3f-a654-2ed1419b66a6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:15.641973 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c01b-93bd-4f3f-a654-2ed1419b66a6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:15.718442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90c955-3440-454a-bb2f-8e8e40859d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:15.719154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c955-3440-454a-bb2f-8e8e40859d2d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:15.719517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c955-3440-454a-bb2f-8e8e40859d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:15.719884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c955-3440-454a-bb2f-8e8e40859d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:15.720627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90c955-3440-454a-bb2f-8e8e40859d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:15.723059 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90c955-3440-454a-bb2f-8e8e40859d2d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:15.734593 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1318/2667] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:15.739699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8bbc3-630c-40b6-a812-680199082e9c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:15.760583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8bbc3-630c-40b6-a812-680199082e9c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:15.767803 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:15.773138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:15.773138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:15.773138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] PATH_INFO: `/v3/projects/998b807cbbf2480c899a7a14786cd49c/users/bb507a6432e04fbdbe317c8b0757c140/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:15.773138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998b807cbbf2480c899a7a14786cd49c, user_id=bb507a6432e04fbdbe317c8b0757c140, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:15.775542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:15.787740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1350/2668] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:15 2022] PUT /identity/v3/projects/998b807cbbf2480c899a7a14786cd49c/users/bb507a6432e04fbdbe317c8b0757c140/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:15.801947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870092-51a5-4b4a-9f7e-ba29d605364e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:15.802528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870092-51a5-4b4a-9f7e-ba29d605364e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:15.802528 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da870092-51a5-4b4a-9f7e-ba29d605364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:15.857123 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-da870092-51a5-4b4a-9f7e-ba29d605364e None None] MFA Rules not processed for user `bb507a6432e04fbdbe317c8b0757c140`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:15.858416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-da870092-51a5-4b4a-9f7e-ba29d605364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:15.907828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:15.943057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1319/2669] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:15.954505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:15.956266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:16.018072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6c085-d289-40d4-833e-5de4ee297034 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:16.022239 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:16.023155 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:16.023578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:16.023697 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:16.034192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:16.035728 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:16.046036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1351/2670] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:16.278854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da870092-51a5-4b4a-9f7e-ba29d605364e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:16.290508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da870092-51a5-4b4a-9f7e-ba29d605364e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:16.293989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785e747-d80f-4abd-bc57-db2bd4fdb0df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:16.294592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e747-d80f-4abd-bc57-db2bd4fdb0df service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:16.294866 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e747-d80f-4abd-bc57-db2bd4fdb0df service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:16.295136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785e747-d80f-4abd-bc57-db2bd4fdb0df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:16.372840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785e747-d80f-4abd-bc57-db2bd4fdb0df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:16.374302 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785e747-d80f-4abd-bc57-db2bd4fdb0df service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:16.384892 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1320/2671] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:19.193339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:19.194852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:19.270084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc16161-4170-4365-8745-075addae62b2 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:19.275158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:19.275810 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:19.276135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:19.276420 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] PATH_INFO: `/v3/users/a9bbe5c96ea3479288e3557d0f1bfcc2` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:19.277593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9bbe5c96ea3479288e3557d0f1bfcc2)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:19.279605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:19.305102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:19.447225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9bbe5c96ea3479288e3557d0f1bfcc2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:19.458423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9bbe5c96ea3479288e3557d0f1bfcc2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:19.480154 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9bbe5c96ea3479288e3557d0f1bfcc2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:19.557259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9bbe5c96ea3479288e3557d0f1bfcc2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:19.557889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9bbe5c96ea3479288e3557d0f1bfcc2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:19.564615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1352/2672] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:19 2022] DELETE /identity/v3/users/a9bbe5c96ea3479288e3557d0f1bfcc2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:19.569914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91735f6-f1ba-46f0-b7ba-ff087f84f18e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:19.570403 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91735f6-f1ba-46f0-b7ba-ff087f84f18e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:19.570502 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91735f6-f1ba-46f0-b7ba-ff087f84f18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:19.591561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-c91735f6-f1ba-46f0-b7ba-ff087f84f18e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:19.593108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c91735f6-f1ba-46f0-b7ba-ff087f84f18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:19.676338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1321/2673] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:19.687740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:19.691613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:19.772693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6f78-6815-4929-949a-b893697c422d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:19.777109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1ab65-54f9-48b8-a852-f62f60667a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:19.777822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ab65-54f9-48b8-a852-f62f60667a83 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:19.778183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ab65-54f9-48b8-a852-f62f60667a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:19.778571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ab65-54f9-48b8-a852-f62f60667a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:19.788950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1ab65-54f9-48b8-a852-f62f60667a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:19.809347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1ab65-54f9-48b8-a852-f62f60667a83 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:19.809347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1353/2674] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:20.354475 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91735f6-f1ba-46f0-b7ba-ff087f84f18e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:20.356277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-c91735f6-f1ba-46f0-b7ba-ff087f84f18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:20.376456 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91735f6-f1ba-46f0-b7ba-ff087f84f18e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:20.387632 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:20.388580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:20.389089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:20.389831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] PATH_INFO: `/v3/projects/0483cf8ce4eb438a8c517bc27526d6f2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:20.391369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0483cf8ce4eb438a8c517bc27526d6f2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:20.394391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:20.537135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0483cf8ce4eb438a8c517bc27526d6f2', 'request_id': 'req-63d58e1e-a222-42ae-b64e-253c7e59c8be'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:20.650260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0483cf8ce4eb438a8c517bc27526d6f2', 'request_id': 'req-63d58e1e-a222-42ae-b64e-253c7e59c8be'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:20.658441 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0483cf8ce4eb438a8c517bc27526d6f2', 'request_id': 'req-63d58e1e-a222-42ae-b64e-253c7e59c8be'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:20.667371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:20.688748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] The token cache is being invalidate because project 0483cf8ce4eb438a8c517bc27526d6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:20.689478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:20.691674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-63d58e1e-a222-42ae-b64e-253c7e59c8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:20.696616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1322/2675] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:20 2022] DELETE /identity/v3/projects/0483cf8ce4eb438a8c517bc27526d6f2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:20.701137 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fed98-6751-4c77-8abf-775ea664b955 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:20.703260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fed98-6751-4c77-8abf-775ea664b955 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:20.704280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fed98-6751-4c77-8abf-775ea664b955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:20.750761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-182fed98-6751-4c77-8abf-775ea664b955 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:20.756686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-182fed98-6751-4c77-8abf-775ea664b955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:20.839392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1354/2676] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:20.848583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2a4c-239a-4307-928c-3841f3bad6ba None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:20.848920 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2a4c-239a-4307-928c-3841f3bad6ba None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:20.849253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc2a4c-239a-4307-928c-3841f3bad6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:20.875548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9dfc2a4c-239a-4307-928c-3841f3bad6ba None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:20.876766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9dfc2a4c-239a-4307-928c-3841f3bad6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:20.897835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1323/2677] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:20.906315 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fed98-6751-4c77-8abf-775ea664b955 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:20.938014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fed98-6751-4c77-8abf-775ea664b955 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:20.960573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:20.973046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:20.973615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:20.974017 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:20.974807 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:20.975224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:20.977040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:20.991011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1355/2678] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:20.995426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2a4c-239a-4307-928c-3841f3bad6ba None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:21.009825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc2a4c-239a-4307-928c-3841f3bad6ba None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:21.027851 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c1a22-d30b-4a74-baab-95509bf3ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:21.028514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1a22-d30b-4a74-baab-95509bf3ff51 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:21.028797 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1a22-d30b-4a74-baab-95509bf3ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:21.029067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1a22-d30b-4a74-baab-95509bf3ff51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:21.029718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c1a22-d30b-4a74-baab-95509bf3ff51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:21.031622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c1a22-d30b-4a74-baab-95509bf3ff51 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:21.514806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1324/2679] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:20 2022] POST /identity/v3/projects => generated 371 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:21.515970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:21.525920 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd242485-92e7-45ae-aaf3-29427fd57045 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:21.550955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:21.582469 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37383af-5c65-4ca6-bb49-c591f834184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:21.583070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37383af-5c65-4ca6-bb49-c591f834184e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:21.583348 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37383af-5c65-4ca6-bb49-c591f834184e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:21.583619 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37383af-5c65-4ca6-bb49-c591f834184e admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:21.584260 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37383af-5c65-4ca6-bb49-c591f834184e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:21.586193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37383af-5c65-4ca6-bb49-c591f834184e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:21.706025 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1356/2680] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:21 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:21.710655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c1a22-d30b-4a74-baab-95509bf3ff51 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:21.720910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c1a22-d30b-4a74-baab-95509bf3ff51 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:21.726338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ddd58-ee18-471b-80e8-3ca78ce3e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:21.727442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ddd58-ee18-471b-80e8-3ca78ce3e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:21.727442 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ddd58-ee18-471b-80e8-3ca78ce3e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:21.727771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ddd58-ee18-471b-80e8-3ca78ce3e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:21.728199 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ddd58-ee18-471b-80e8-3ca78ce3e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:21.729884 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ddd58-ee18-471b-80e8-3ca78ce3e1ce admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:21.743004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1325/2681] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:21.745326 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37383af-5c65-4ca6-bb49-c591f834184e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:21.755817 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37383af-5c65-4ca6-bb49-c591f834184e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:21.760836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614480e-857d-45b8-bd41-1cd79a0252ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:21.761459 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614480e-857d-45b8-bd41-1cd79a0252ee admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:21.761717 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614480e-857d-45b8-bd41-1cd79a0252ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:21.761987 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614480e-857d-45b8-bd41-1cd79a0252ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:21.762636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614480e-857d-45b8-bd41-1cd79a0252ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:21.764261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614480e-857d-45b8-bd41-1cd79a0252ee admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:21.775491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1357/2682] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:21.781171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ddd58-ee18-471b-80e8-3ca78ce3e1ce admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:21.790980 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ddd58-ee18-471b-80e8-3ca78ce3e1ce admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:21.795815 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:21.796508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:21.796792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:21.797067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] PATH_INFO: `/v3/projects/31268c8c8c0f40fcbe1f5633975b2609/users/7d6d9713a927415d8618bacd76622280/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:21.813566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31268c8c8c0f40fcbe1f5633975b2609, user_id=7d6d9713a927415d8618bacd76622280, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:21.816550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:21.926203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1326/2683] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:21 2022] PUT /identity/v3/projects/31268c8c8c0f40fcbe1f5633975b2609/users/7d6d9713a927415d8618bacd76622280/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:32:21.934267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bfa3-3161-4a72-bd08-ca35881a6b86 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:21.934556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bfa3-3161-4a72-bd08-ca35881a6b86 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:21.934836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565bfa3-3161-4a72-bd08-ca35881a6b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:21.959079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-7565bfa3-3161-4a72-bd08-ca35881a6b86 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:21.960323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7565bfa3-3161-4a72-bd08-ca35881a6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:22.023035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1358/2684] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:22.032849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:22.035424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:22.092116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b920fba-7625-48f8-b736-945ffc257839 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:22.095880 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0886834-a4a7-42e0-aa89-4a4d97a6bf2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:22.097200 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0886834-a4a7-42e0-aa89-4a4d97a6bf2a service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:22.097674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0886834-a4a7-42e0-aa89-4a4d97a6bf2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:22.098927 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0886834-a4a7-42e0-aa89-4a4d97a6bf2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:22.107383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0886834-a4a7-42e0-aa89-4a4d97a6bf2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:22.108854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0886834-a4a7-42e0-aa89-4a4d97a6bf2a service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:22.118645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1327/2685] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:23.635786 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565bfa3-3161-4a72-bd08-ca35881a6b86 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:23.637336 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-7565bfa3-3161-4a72-bd08-ca35881a6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:23.650313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565bfa3-3161-4a72-bd08-ca35881a6b86 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:23.658185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:23.659657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:23.660008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:23.660367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] PATH_INFO: `/v3/users/7823fcc19d0d407793641e3e890c1845` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:23.661606 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7823fcc19d0d407793641e3e890c1845)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:23.663633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:23.895647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7823fcc19d0d407793641e3e890c1845'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:23.903189 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7823fcc19d0d407793641e3e890c1845'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:23.916144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7823fcc19d0d407793641e3e890c1845'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:23.991784 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7823fcc19d0d407793641e3e890c1845'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:23.992601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7823fcc19d0d407793641e3e890c1845'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:24.000482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1359/2686] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:23 2022] DELETE /identity/v3/users/7823fcc19d0d407793641e3e890c1845 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:24.005981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b07d6-3d50-4737-bbde-3abdf1482cf3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:24.006529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b07d6-3d50-4737-bbde-3abdf1482cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:24.006529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b07d6-3d50-4737-bbde-3abdf1482cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:24.027578 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b38b07d6-3d50-4737-bbde-3abdf1482cf3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:24.028839 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b38b07d6-3d50-4737-bbde-3abdf1482cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:24.100285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1328/2687] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:24.111092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:24.113364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:24.143566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:24.198366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1706-2361-40a0-a2fa-27091b05f6ea admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:24.205471 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98290dd9-b10a-406d-9b65-daeee9fdabec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:24.207075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290dd9-b10a-406d-9b65-daeee9fdabec service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:24.207345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290dd9-b10a-406d-9b65-daeee9fdabec service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:24.207612 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98290dd9-b10a-406d-9b65-daeee9fdabec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:24.220200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98290dd9-b10a-406d-9b65-daeee9fdabec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:24.222601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98290dd9-b10a-406d-9b65-daeee9fdabec service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:24.240602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1360/2688] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:24.879450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b07d6-3d50-4737-bbde-3abdf1482cf3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:24.881010 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b38b07d6-3d50-4737-bbde-3abdf1482cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:24.894959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b07d6-3d50-4737-bbde-3abdf1482cf3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:24.906551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:24.910887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:24.910887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:24.910887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] PATH_INFO: `/v3/projects/00204192cdb5467cb0763353828417f0` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:24.910887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00204192cdb5467cb0763353828417f0)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:24.911752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:25.045784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:25.061422 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00204192cdb5467cb0763353828417f0', 'request_id': 'req-e6ce5324-0882-44bb-9dfd-964cf2e68514'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.148886 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00204192cdb5467cb0763353828417f0', 'request_id': 'req-e6ce5324-0882-44bb-9dfd-964cf2e68514'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.156171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00204192cdb5467cb0763353828417f0', 'request_id': 'req-e6ce5324-0882-44bb-9dfd-964cf2e68514'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.169206 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] The token cache is being invalidate because project 00204192cdb5467cb0763353828417f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:25.170807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.170807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.171720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1329/2689] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:24 2022] DELETE /identity/v3/projects/00204192cdb5467cb0763353828417f0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:25.175884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98290dd9-b10a-406d-9b65-daeee9fdabec service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:25.188937 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98290dd9-b10a-406d-9b65-daeee9fdabec service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:25.262625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:25.263281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:25.263586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:25.263827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] PATH_INFO: `/v3/users/bb507a6432e04fbdbe317c8b0757c140` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:25.265000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb507a6432e04fbdbe317c8b0757c140)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:25.266951 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:25.479206 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb507a6432e04fbdbe317c8b0757c140'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.490253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb507a6432e04fbdbe317c8b0757c140'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.521798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb507a6432e04fbdbe317c8b0757c140'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.591955 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb507a6432e04fbdbe317c8b0757c140'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.592905 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-620757b3-fe1c-42af-b0a2-2449176a9198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb507a6432e04fbdbe317c8b0757c140'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:25.605943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1361/2690] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:25 2022] DELETE /identity/v3/users/bb507a6432e04fbdbe317c8b0757c140 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:26.155524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:26.157242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:26.196861 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce5324-0882-44bb-9dfd-964cf2e68514 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:26.338791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:26.339744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:26.340203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:26.340664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] PATH_INFO: `/v3/projects/998b807cbbf2480c899a7a14786cd49c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:26.342558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=998b807cbbf2480c899a7a14786cd49c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:26.344757 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:27.309621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998b807cbbf2480c899a7a14786cd49c', 'request_id': 'req-f0e26835-8dec-46a2-a841-655a3ebe4a2d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:27.443600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998b807cbbf2480c899a7a14786cd49c', 'request_id': 'req-f0e26835-8dec-46a2-a841-655a3ebe4a2d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:27.454871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998b807cbbf2480c899a7a14786cd49c', 'request_id': 'req-f0e26835-8dec-46a2-a841-655a3ebe4a2d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:27.480983 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] The token cache is being invalidate because project 998b807cbbf2480c899a7a14786cd49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:27.481284 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:27.491552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f0e26835-8dec-46a2-a841-655a3ebe4a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:27.491552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1330/2691] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:26 2022] DELETE /identity/v3/projects/998b807cbbf2480c899a7a14786cd49c => generated 0 bytes in 1330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:27.492022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646999ce-fea8-4aee-b9dc-2fd8014c43a0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:27.492022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646999ce-fea8-4aee-b9dc-2fd8014c43a0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:27.492022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646999ce-fea8-4aee-b9dc-2fd8014c43a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:27.517498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-646999ce-fea8-4aee-b9dc-2fd8014c43a0 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:27.519588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-646999ce-fea8-4aee-b9dc-2fd8014c43a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:27.564072 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:27.591013 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1362/2692] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:27.599459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370104-e037-4069-8db1-79d67f9ffe9e None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:27.599749 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370104-e037-4069-8db1-79d67f9ffe9e None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:27.600027 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f370104-e037-4069-8db1-79d67f9ffe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:27.619750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1f370104-e037-4069-8db1-79d67f9ffe9e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:27.621016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1f370104-e037-4069-8db1-79d67f9ffe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:27.630656 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1331/2693] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:27.635140 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646999ce-fea8-4aee-b9dc-2fd8014c43a0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:27.645811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646999ce-fea8-4aee-b9dc-2fd8014c43a0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:27.650741 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:27.653913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:27.653913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:27.653913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:27.653913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:27.653913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:27.654503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:27.666445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1363/2694] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:27.671401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f370104-e037-4069-8db1-79d67f9ffe9e None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:27.681404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f370104-e037-4069-8db1-79d67f9ffe9e None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:27.686138 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d987f3-83f1-4a27-acf8-b18ef9d9a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:27.686742 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d987f3-83f1-4a27-acf8-b18ef9d9a39b admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:27.687021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d987f3-83f1-4a27-acf8-b18ef9d9a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:27.687313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d987f3-83f1-4a27-acf8-b18ef9d9a39b admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:27.687928 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d987f3-83f1-4a27-acf8-b18ef9d9a39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:27.690586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d987f3-83f1-4a27-acf8-b18ef9d9a39b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:27.793292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1332/2695] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:27 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:27.797086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:27.808666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb47020-38cb-432f-aa5f-21cf42444326 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:27.895954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64ec5-9279-49fb-93c6-cabd1a82e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:27.896691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64ec5-9279-49fb-93c6-cabd1a82e7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:27.897038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64ec5-9279-49fb-93c6-cabd1a82e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:27.897379 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64ec5-9279-49fb-93c6-cabd1a82e7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:27.898077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb64ec5-9279-49fb-93c6-cabd1a82e7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:27.900053 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb64ec5-9279-49fb-93c6-cabd1a82e7e5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:28.032596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1364/2696] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:27 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:32:28.033845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d987f3-83f1-4a27-acf8-b18ef9d9a39b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:28.052606 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d987f3-83f1-4a27-acf8-b18ef9d9a39b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:28.055003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68d14-6526-4098-bee4-cebc9293da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:28.055754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68d14-6526-4098-bee4-cebc9293da43 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.056557 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68d14-6526-4098-bee4-cebc9293da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.056912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c68d14-6526-4098-bee4-cebc9293da43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.058455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c68d14-6526-4098-bee4-cebc9293da43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:28.068745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c68d14-6526-4098-bee4-cebc9293da43 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:28.082386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1333/2697] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:28.087318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64ec5-9279-49fb-93c6-cabd1a82e7e5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:28.099531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64ec5-9279-49fb-93c6-cabd1a82e7e5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:28.104954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ba718-9ad9-4b37-955b-20d746e61968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:28.105562 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ba718-9ad9-4b37-955b-20d746e61968 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.106443 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ba718-9ad9-4b37-955b-20d746e61968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.106723 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ba718-9ad9-4b37-955b-20d746e61968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.107418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ba718-9ad9-4b37-955b-20d746e61968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:28.109052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ba718-9ad9-4b37-955b-20d746e61968 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:28.122737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1365/2698] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:28.126907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68d14-6526-4098-bee4-cebc9293da43 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:28.141285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c68d14-6526-4098-bee4-cebc9293da43 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:28.146975 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc527356-8d70-4477-a433-f376f4e3c320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:28.147716 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc527356-8d70-4477-a433-f376f4e3c320 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.148339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc527356-8d70-4477-a433-f376f4e3c320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.148477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc527356-8d70-4477-a433-f376f4e3c320 admin admin] PATH_INFO: `/v3/projects/1e091fbc2d384d9a9de28c8aa31b7de0/users/db4d580602e64b29b7cae4b2f5aed339/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.153157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:28.171157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc527356-8d70-4477-a433-f376f4e3c320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e091fbc2d384d9a9de28c8aa31b7de0, user_id=db4d580602e64b29b7cae4b2f5aed339, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:28.176495 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc527356-8d70-4477-a433-f376f4e3c320 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:28.265526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1334/2699] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:28 2022] PUT /identity/v3/projects/1e091fbc2d384d9a9de28c8aa31b7de0/users/db4d580602e64b29b7cae4b2f5aed339/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:28.267862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180ed1f-88c3-4c52-b54e-c609bf5805ae None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.269013 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180ed1f-88c3-4c52-b54e-c609bf5805ae None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.269013 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180ed1f-88c3-4c52-b54e-c609bf5805ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.320136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-d180ed1f-88c3-4c52-b54e-c609bf5805ae None None] MFA Rules not processed for user `db4d580602e64b29b7cae4b2f5aed339`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:28.321615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d180ed1f-88c3-4c52-b54e-c609bf5805ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:28.443966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1366/2700] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:28.444161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc527356-8d70-4477-a433-f376f4e3c320 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:28.544388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a919-943c-4174-90ce-6dbe193ece64 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.545737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a919-943c-4174-90ce-6dbe193ece64 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.546035 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4a919-943c-4174-90ce-6dbe193ece64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.557072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc527356-8d70-4477-a433-f376f4e3c320 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:28.563651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:28.564408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.564936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.569244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.569244 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:28.570966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:28.587431 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f0a4a919-943c-4174-90ce-6dbe193ece64 None None] MFA Rules not processed for user `7d6d9713a927415d8618bacd76622280`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:28.588870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f0a4a919-943c-4174-90ce-6dbe193ece64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:28.637863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:28.689389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1367/2701] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:28.691555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c561-9100-4deb-8c80-12b89c7cdda0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.692036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c561-9100-4deb-8c80-12b89c7cdda0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.692544 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2c561-9100-4deb-8c80-12b89c7cdda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.700527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1335/2702] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:28 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:32:28.700527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:28.700527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:28.714731 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-23c2c561-9100-4deb-8c80-12b89c7cdda0 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:28.716101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-23c2c561-9100-4deb-8c80-12b89c7cdda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:28.778744 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570497-99af-4445-9ed0-65645bf86d07 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:28.782084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1368/2703] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:28.782916 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2c561-9100-4deb-8c80-12b89c7cdda0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:28.785934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:28.786752 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.787240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.787490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.788462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:28.790599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:28.799647 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2c561-9100-4deb-8c80-12b89c7cdda0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:28.804964 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fdf92-90f7-4319-9f9d-e575d7552819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:28.805806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fdf92-90f7-4319-9f9d-e575d7552819 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.806090 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fdf92-90f7-4319-9f9d-e575d7552819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.806364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fdf92-90f7-4319-9f9d-e575d7552819 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:28.807106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fdf92-90f7-4319-9f9d-e575d7552819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:28.809087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fdf92-90f7-4319-9f9d-e575d7552819 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:28.885286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1336/2704] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:28 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:28.886733 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:28.887711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:28.917845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1369/2705] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:28 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:28.919038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fdf92-90f7-4319-9f9d-e575d7552819 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:28.937863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fdf92-90f7-4319-9f9d-e575d7552819 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:28.954393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:28.974266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11d6bd-c540-4d47-a6d8-aa248120ba85 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:28.980689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8b72c-bb93-4f23-a26b-159805612706 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:28.981775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8b72c-bb93-4f23-a26b-159805612706 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:28.982204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8b72c-bb93-4f23-a26b-159805612706 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:28.982480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8b72c-bb93-4f23-a26b-159805612706 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.009906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67123f-bac6-4c94-916d-59a59a7e604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.010838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67123f-bac6-4c94-916d-59a59a7e604a admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.011161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67123f-bac6-4c94-916d-59a59a7e604a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.011441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67123f-bac6-4c94-916d-59a59a7e604a admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.012087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67123f-bac6-4c94-916d-59a59a7e604a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.014374 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67123f-bac6-4c94-916d-59a59a7e604a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.048654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8b72c-bb93-4f23-a26b-159805612706 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.050680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8b72c-bb93-4f23-a26b-159805612706 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.059521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1337/2706] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:32:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:32:29.060485 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8b72c-bb93-4f23-a26b-159805612706 service swift] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.075970 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8b72c-bb93-4f23-a26b-159805612706 service swift] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.087621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f202c-3bc3-45e5-8f46-3873b37604ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.087621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f202c-3bc3-45e5-8f46-3873b37604ae admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.087621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f202c-3bc3-45e5-8f46-3873b37604ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.088064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f202c-3bc3-45e5-8f46-3873b37604ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.088763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f202c-3bc3-45e5-8f46-3873b37604ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.090436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f202c-3bc3-45e5-8f46-3873b37604ae admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.118053 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1338/2707] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:29.122518 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f202c-3bc3-45e5-8f46-3873b37604ae admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.137072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f202c-3bc3-45e5-8f46-3873b37604ae admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.150740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18fad9-9270-457f-8f36-eed25f52d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.150740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18fad9-9270-457f-8f36-eed25f52d334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.150740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18fad9-9270-457f-8f36-eed25f52d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.151496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1370/2708] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:28 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:29.152818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18fad9-9270-457f-8f36-eed25f52d334 admin admin] PATH_INFO: `/v3/projects/496fe07943b447b4bd5f222ff32f9b4a/users/687feac1c4e849b1b8391c23bb77e1f7/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.154434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67123f-bac6-4c94-916d-59a59a7e604a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.171676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18fad9-9270-457f-8f36-eed25f52d334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496fe07943b447b4bd5f222ff32f9b4a, user_id=687feac1c4e849b1b8391c23bb77e1f7, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.172968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67123f-bac6-4c94-916d-59a59a7e604a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.179252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38512bd-ea2b-48d8-97e0-0e1e82260e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.181682 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18fad9-9270-457f-8f36-eed25f52d334 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.181806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38512bd-ea2b-48d8-97e0-0e1e82260e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.181806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38512bd-ea2b-48d8-97e0-0e1e82260e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.181806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38512bd-ea2b-48d8-97e0-0e1e82260e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.181806 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38512bd-ea2b-48d8-97e0-0e1e82260e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.184160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38512bd-ea2b-48d8-97e0-0e1e82260e5a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.196908 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1371/2709] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:29.201061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38512bd-ea2b-48d8-97e0-0e1e82260e5a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.211542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38512bd-ea2b-48d8-97e0-0e1e82260e5a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.217358 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3ed9-f68d-4859-9e73-0747349efe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.218037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3ed9-f68d-4859-9e73-0747349efe29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.218322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3ed9-f68d-4859-9e73-0747349efe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.218593 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b3ed9-f68d-4859-9e73-0747349efe29 admin admin] PATH_INFO: `/v3/projects/d11cb7a48f894deb9481e7c5a713946c/users/c79f6473093f48b98c91fbcaa320afa3/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.240684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b3ed9-f68d-4859-9e73-0747349efe29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11cb7a48f894deb9481e7c5a713946c, user_id=c79f6473093f48b98c91fbcaa320afa3, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.243556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b3ed9-f68d-4859-9e73-0747349efe29 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.293651 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1339/2710] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:29 2022] PUT /identity/v3/projects/496fe07943b447b4bd5f222ff32f9b4a/users/687feac1c4e849b1b8391c23bb77e1f7/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:29.297349 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18fad9-9270-457f-8f36-eed25f52d334 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.369167 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18fad9-9270-457f-8f36-eed25f52d334 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.371776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1372/2711] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:29 2022] PUT /identity/v3/projects/d11cb7a48f894deb9481e7c5a713946c/users/c79f6473093f48b98c91fbcaa320afa3/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:32:29.375495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3ed9-f68d-4859-9e73-0747349efe29 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.385660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:29.440983 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887b06-e54c-4385-bf5d-16954d8f48e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.441617 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887b06-e54c-4385-bf5d-16954d8f48e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.441894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887b06-e54c-4385-bf5d-16954d8f48e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.442170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887b06-e54c-4385-bf5d-16954d8f48e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.442841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e887b06-e54c-4385-bf5d-16954d8f48e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.444674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e887b06-e54c-4385-bf5d-16954d8f48e8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.446722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b3ed9-f68d-4859-9e73-0747349efe29 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.451866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a51416-e7e6-42eb-b89a-e745c562c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.452705 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a51416-e7e6-42eb-b89a-e745c562c39e admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.453158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a51416-e7e6-42eb-b89a-e745c562c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.453595 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a51416-e7e6-42eb-b89a-e745c562c39e admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.454406 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a51416-e7e6-42eb-b89a-e745c562c39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.456166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1340/2712] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:32:29.456725 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a51416-e7e6-42eb-b89a-e745c562c39e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.460207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887b06-e54c-4385-bf5d-16954d8f48e8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.468343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1373/2713] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:32:29.470740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:29.473492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a51416-e7e6-42eb-b89a-e745c562c39e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.477577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887b06-e54c-4385-bf5d-16954d8f48e8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.482612 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3adea-f4be-4d17-85d9-ec4e83285523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.483283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3adea-f4be-4d17-85d9-ec4e83285523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.483565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3adea-f4be-4d17-85d9-ec4e83285523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.483835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3adea-f4be-4d17-85d9-ec4e83285523 admin admin] PATH_INFO: `/v3/projects/496fe07943b447b4bd5f222ff32f9b4a/users/687feac1c4e849b1b8391c23bb77e1f7/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.485971 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3adea-f4be-4d17-85d9-ec4e83285523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496fe07943b447b4bd5f222ff32f9b4a, user_id=687feac1c4e849b1b8391c23bb77e1f7, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.487557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a51416-e7e6-42eb-b89a-e745c562c39e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.490018 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3adea-f4be-4d17-85d9-ec4e83285523 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.493065 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.493834 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.494037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.494263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] PATH_INFO: `/v3/projects/d11cb7a48f894deb9481e7c5a713946c/users/c79f6473093f48b98c91fbcaa320afa3/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.496240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11cb7a48f894deb9481e7c5a713946c, user_id=c79f6473093f48b98c91fbcaa320afa3, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.498890 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.509829 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1341/2714] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:29 2022] PUT /identity/v3/projects/496fe07943b447b4bd5f222ff32f9b4a/users/687feac1c4e849b1b8391c23bb77e1f7/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:29.511516 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce4c3-34fe-49a8-b609-ce2fdc516727 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.511809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce4c3-34fe-49a8-b609-ce2fdc516727 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.512088 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce4c3-34fe-49a8-b609-ce2fdc516727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.520546 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1374/2715] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:29 2022] PUT /identity/v3/projects/d11cb7a48f894deb9481e7c5a713946c/users/c79f6473093f48b98c91fbcaa320afa3/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:29.544622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-528ce4c3-34fe-49a8-b609-ce2fdc516727 None None] MFA Rules not processed for user `687feac1c4e849b1b8391c23bb77e1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:29.546480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-528ce4c3-34fe-49a8-b609-ce2fdc516727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:29.623535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1342/2716] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:29.635269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:29.637160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:29.712147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57577f-d7eb-4304-9542-50a7fcad2cfc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:29.716280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63673139-3f17-4bc3-9cb0-63cf111c83ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:29.717048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673139-3f17-4bc3-9cb0-63cf111c83ba service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:29.717407 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673139-3f17-4bc3-9cb0-63cf111c83ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:29.717753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673139-3f17-4bc3-9cb0-63cf111c83ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:29.728961 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63673139-3f17-4bc3-9cb0-63cf111c83ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:29.730695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63673139-3f17-4bc3-9cb0-63cf111c83ba service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:29.741742 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1375/2717] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:31.014778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ce4c3-34fe-49a8-b609-ce2fdc516727 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:31.083089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ce4c3-34fe-49a8-b609-ce2fdc516727 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:31.088834 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:31.089545 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:31.089820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:31.090090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] PATH_INFO: `/v3/users/db4d580602e64b29b7cae4b2f5aed339` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:31.091234 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4d580602e64b29b7cae4b2f5aed339)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:31.093362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:31.307415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4d580602e64b29b7cae4b2f5aed339'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:31.315717 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4d580602e64b29b7cae4b2f5aed339'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:31.380424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4d580602e64b29b7cae4b2f5aed339'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:31.399135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:31.401365 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4d580602e64b29b7cae4b2f5aed339'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:31.402787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4d580602e64b29b7cae4b2f5aed339'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:31.422446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673146dd-9b2b-49b4-9ae2-04234e52e2c1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:31.422957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673146dd-9b2b-49b4-9ae2-04234e52e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:31.423240 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673146dd-9b2b-49b4-9ae2-04234e52e2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:31.428550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1343/2718] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:31 2022] DELETE /identity/v3/users/db4d580602e64b29b7cae4b2f5aed339 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:31.447914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-673146dd-9b2b-49b4-9ae2-04234e52e2c1 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:31.449328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-673146dd-9b2b-49b4-9ae2-04234e52e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:31.517197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1376/2719] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:31.528532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:31.530021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:31.623280 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d4ff2-a798-4d48-9ef3-88a270cc39cf admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:31.628421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770498c-d519-4582-9a54-c9281e6589d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:31.628985 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770498c-d519-4582-9a54-c9281e6589d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:31.629266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770498c-d519-4582-9a54-c9281e6589d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:31.629539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770498c-d519-4582-9a54-c9281e6589d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:31.643964 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770498c-d519-4582-9a54-c9281e6589d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:31.645687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770498c-d519-4582-9a54-c9281e6589d1 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:31.657089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1344/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:32.223611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673146dd-9b2b-49b4-9ae2-04234e52e2c1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:32.225389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-673146dd-9b2b-49b4-9ae2-04234e52e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:32.242080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673146dd-9b2b-49b4-9ae2-04234e52e2c1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:32.249219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:32.250086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:32.250517 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:32.250942 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] PATH_INFO: `/v3/projects/1e091fbc2d384d9a9de28c8aa31b7de0` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:32.253521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e091fbc2d384d9a9de28c8aa31b7de0)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:32.256151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:32.407392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:32.461557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e091fbc2d384d9a9de28c8aa31b7de0', 'request_id': 'req-ac4680d3-0098-4290-8dc9-af576428d185'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:32.479885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e091fbc2d384d9a9de28c8aa31b7de0', 'request_id': 'req-ac4680d3-0098-4290-8dc9-af576428d185'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:32.488392 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e091fbc2d384d9a9de28c8aa31b7de0', 'request_id': 'req-ac4680d3-0098-4290-8dc9-af576428d185'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:32.633985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] The token cache is being invalidate because project 1e091fbc2d384d9a9de28c8aa31b7de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:32.634277 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:32.635158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:32.644838 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1377/2721] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:32 2022] DELETE /identity/v3/projects/1e091fbc2d384d9a9de28c8aa31b7de0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:32.648989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770498c-d519-4582-9a54-c9281e6589d1 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:32.663404 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770498c-d519-4582-9a54-c9281e6589d1 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:32.739827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:32.740611 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:32.740991 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:32.741337 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] PATH_INFO: `/v3/users/687feac1c4e849b1b8391c23bb77e1f7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:32.742589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=687feac1c4e849b1b8391c23bb77e1f7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:32.744907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:32.960141 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687feac1c4e849b1b8391c23bb77e1f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:32.973828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687feac1c4e849b1b8391c23bb77e1f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.077616 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687feac1c4e849b1b8391c23bb77e1f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.104662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687feac1c4e849b1b8391c23bb77e1f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.105409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-c2f141dd-98cf-4337-a793-2c3e7e10b6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687feac1c4e849b1b8391c23bb77e1f7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.119436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1345/2722] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:32 2022] DELETE /identity/v3/users/687feac1c4e849b1b8391c23bb77e1f7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:33.600123 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:33.602317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:33.618912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4680d3-0098-4290-8dc9-af576428d185 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:33.701820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:33.702474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:33.702738 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:33.703011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] PATH_INFO: `/v3/projects/496fe07943b447b4bd5f222ff32f9b4a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:33.704180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=496fe07943b447b4bd5f222ff32f9b4a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:33.706463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:33.858729 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496fe07943b447b4bd5f222ff32f9b4a', 'request_id': 'req-381c36ac-6d39-47bb-8825-db95a3eee9bc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.868472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496fe07943b447b4bd5f222ff32f9b4a', 'request_id': 'req-381c36ac-6d39-47bb-8825-db95a3eee9bc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.875359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496fe07943b447b4bd5f222ff32f9b4a', 'request_id': 'req-381c36ac-6d39-47bb-8825-db95a3eee9bc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.968591 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] The token cache is being invalidate because project 496fe07943b447b4bd5f222ff32f9b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:33.968839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.969432 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-381c36ac-6d39-47bb-8825-db95a3eee9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:33.971636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1378/2723] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:33 2022] DELETE /identity/v3/projects/496fe07943b447b4bd5f222ff32f9b4a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:33.977745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c82b44-0ff8-4cb1-b67d-3eaf6c3e6641 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:33.982321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c82b44-0ff8-4cb1-b67d-3eaf6c3e6641 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:33.982321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c82b44-0ff8-4cb1-b67d-3eaf6c3e6641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.005720 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d1c82b44-0ff8-4cb1-b67d-3eaf6c3e6641 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:34.007260 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d1c82b44-0ff8-4cb1-b67d-3eaf6c3e6641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:34.025811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:34.104464 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1346/2724] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:34.110310 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c0cf2-512c-490d-a21d-f039d15360a1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:34.110653 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c0cf2-512c-490d-a21d-f039d15360a1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:34.110934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c0cf2-512c-490d-a21d-f039d15360a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.144495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-722c0cf2-512c-490d-a21d-f039d15360a1 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:34.146345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-722c0cf2-512c-490d-a21d-f039d15360a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:34.160665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1379/2725] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:34.165993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c82b44-0ff8-4cb1-b67d-3eaf6c3e6641 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:34.180798 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c82b44-0ff8-4cb1-b67d-3eaf6c3e6641 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:34.188023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:34.189548 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:34.190810 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:34.191330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.192956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:34.193607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:34.197378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:34.218159 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1347/2726] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:34.221783 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c0cf2-512c-490d-a21d-f039d15360a1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:34.232664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c0cf2-512c-490d-a21d-f039d15360a1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:34.243313 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8084f-812d-4236-9b3c-3434fb2ce352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:34.244385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8084f-812d-4236-9b3c-3434fb2ce352 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:34.244894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8084f-812d-4236-9b3c-3434fb2ce352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:34.245439 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8084f-812d-4236-9b3c-3434fb2ce352 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.246493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8084f-812d-4236-9b3c-3434fb2ce352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:34.249178 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8084f-812d-4236-9b3c-3434fb2ce352 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:34.345816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1380/2727] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:34 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:34.351375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:34.366540 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f9780-f65b-417e-9f6e-bc258cb74188 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:34.433283 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8499c2-a4b1-4035-9f4e-2d2c387dd641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:34.439031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8499c2-a4b1-4035-9f4e-2d2c387dd641 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:34.439031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8499c2-a4b1-4035-9f4e-2d2c387dd641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:34.439031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8499c2-a4b1-4035-9f4e-2d2c387dd641 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.439031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8499c2-a4b1-4035-9f4e-2d2c387dd641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:34.439031 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8499c2-a4b1-4035-9f4e-2d2c387dd641 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:34.558725 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1348/2728] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:34 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:34.559939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8084f-812d-4236-9b3c-3434fb2ce352 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:34.570643 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8084f-812d-4236-9b3c-3434fb2ce352 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:34.575499 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a2547-ddc7-44e0-9e98-b7f4f50aaaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:34.576111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2547-ddc7-44e0-9e98-b7f4f50aaaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:34.576429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2547-ddc7-44e0-9e98-b7f4f50aaaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:34.576821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a2547-ddc7-44e0-9e98-b7f4f50aaaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.577418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a2547-ddc7-44e0-9e98-b7f4f50aaaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:34.581555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a2547-ddc7-44e0-9e98-b7f4f50aaaa3 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:34.595114 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1381/2729] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:34.597070 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8499c2-a4b1-4035-9f4e-2d2c387dd641 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:34.609514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8499c2-a4b1-4035-9f4e-2d2c387dd641 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:34.618935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57caa88-e4ae-49d6-a982-b4d629707ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:34.619755 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57caa88-e4ae-49d6-a982-b4d629707ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:34.620186 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57caa88-e4ae-49d6-a982-b4d629707ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:34.620642 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57caa88-e4ae-49d6-a982-b4d629707ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.621600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57caa88-e4ae-49d6-a982-b4d629707ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:34.623426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57caa88-e4ae-49d6-a982-b4d629707ceb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:34.637445 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1349/2730] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:34.642076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a2547-ddc7-44e0-9e98-b7f4f50aaaa3 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:34.656250 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a2547-ddc7-44e0-9e98-b7f4f50aaaa3 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:34.662707 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff931ac-ba00-4b00-af02-f6dd3d8d765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:34.663589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff931ac-ba00-4b00-af02-f6dd3d8d765f admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:34.664031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff931ac-ba00-4b00-af02-f6dd3d8d765f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:34.664495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff931ac-ba00-4b00-af02-f6dd3d8d765f admin admin] PATH_INFO: `/v3/projects/d2e85a249887473883158908b4bd85e2/users/cb29b3f5426c40ffbfd039c953fca933/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.667111 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:34.680616 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff931ac-ba00-4b00-af02-f6dd3d8d765f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e85a249887473883158908b4bd85e2, user_id=cb29b3f5426c40ffbfd039c953fca933, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:34.683799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff931ac-ba00-4b00-af02-f6dd3d8d765f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:34.810669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1382/2731] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:34 2022] PUT /identity/v3/projects/d2e85a249887473883158908b4bd85e2/users/cb29b3f5426c40ffbfd039c953fca933/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:34.879974 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a81087-c9a3-4f6e-b194-645f46c3a70b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:34.880259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a81087-c9a3-4f6e-b194-645f46c3a70b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:34.880563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a81087-c9a3-4f6e-b194-645f46c3a70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:34.910259 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-79a81087-c9a3-4f6e-b194-645f46c3a70b None None] MFA Rules not processed for user `cb29b3f5426c40ffbfd039c953fca933`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:34.911470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-79a81087-c9a3-4f6e-b194-645f46c3a70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:34.988767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1350/2732] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:34.993551 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff931ac-ba00-4b00-af02-f6dd3d8d765f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:35.085753 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff931ac-ba00-4b00-af02-f6dd3d8d765f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:35.095712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa2f70-4309-4ab8-9af2-f54e5f74ddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:35.097465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa2f70-4309-4ab8-9af2-f54e5f74ddb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:35.098063 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa2f70-4309-4ab8-9af2-f54e5f74ddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:35.098712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa2f70-4309-4ab8-9af2-f54e5f74ddb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:35.099945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa2f70-4309-4ab8-9af2-f54e5f74ddb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:35.102559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa2f70-4309-4ab8-9af2-f54e5f74ddb0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:35.200104 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1383/2733] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:34 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:32:35.201425 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a81087-c9a3-4f6e-b194-645f46c3a70b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:35.213684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a81087-c9a3-4f6e-b194-645f46c3a70b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:35.224820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:35.291676 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dae9c-09b8-4d2c-bbb1-030bb4874e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:35.291995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dae9c-09b8-4d2c-bbb1-030bb4874e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:35.292748 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dae9c-09b8-4d2c-bbb1-030bb4874e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:35.293035 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dae9c-09b8-4d2c-bbb1-030bb4874e81 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:35.294386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dae9c-09b8-4d2c-bbb1-030bb4874e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:35.296372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dae9c-09b8-4d2c-bbb1-030bb4874e81 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:35.402220 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1351/2734] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:35 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:35.403798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa2f70-4309-4ab8-9af2-f54e5f74ddb0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:35.415821 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa2f70-4309-4ab8-9af2-f54e5f74ddb0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:35.421884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8410547-d7eb-4eee-af05-3e7c75e01bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:35.422510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8410547-d7eb-4eee-af05-3e7c75e01bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:35.423183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8410547-d7eb-4eee-af05-3e7c75e01bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:35.423183 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8410547-d7eb-4eee-af05-3e7c75e01bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:35.423893 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8410547-d7eb-4eee-af05-3e7c75e01bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:35.425594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8410547-d7eb-4eee-af05-3e7c75e01bc5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:35.439936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1384/2735] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:32:35.445665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dae9c-09b8-4d2c-bbb1-030bb4874e81 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:35.456668 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dae9c-09b8-4d2c-bbb1-030bb4874e81 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:35.463322 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e909-a047-4295-8779-278b087f12df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:35.464176 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e909-a047-4295-8779-278b087f12df admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:35.469843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e909-a047-4295-8779-278b087f12df admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:35.469843 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612e909-a047-4295-8779-278b087f12df admin admin] PATH_INFO: `/v3/projects/17b77b8f0d554798a4f62eef2aa9a76a/users/c96d15651b884e51b0707a66435baa48/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:35.482029 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612e909-a047-4295-8779-278b087f12df admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b77b8f0d554798a4f62eef2aa9a76a, user_id=c96d15651b884e51b0707a66435baa48, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:35.484878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e612e909-a047-4295-8779-278b087f12df admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:35.573923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1352/2736] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:35 2022] PUT /identity/v3/projects/17b77b8f0d554798a4f62eef2aa9a76a/users/c96d15651b884e51b0707a66435baa48/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:35.578007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8410547-d7eb-4eee-af05-3e7c75e01bc5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:35.589830 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8410547-d7eb-4eee-af05-3e7c75e01bc5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:35.667455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11326892-1bb2-453b-8947-70f8d86f602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:35.668248 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326892-1bb2-453b-8947-70f8d86f602b admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:35.668384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326892-1bb2-453b-8947-70f8d86f602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:35.668639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11326892-1bb2-453b-8947-70f8d86f602b admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:35.669446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11326892-1bb2-453b-8947-70f8d86f602b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:35.671086 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11326892-1bb2-453b-8947-70f8d86f602b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:35.682411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1385/2737] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:35.686914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e909-a047-4295-8779-278b087f12df admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:35.717174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612e909-a047-4295-8779-278b087f12df admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:35.723963 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:35.724978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:35.725389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:35.725766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] PATH_INFO: `/v3/projects/17b77b8f0d554798a4f62eef2aa9a76a/users/c96d15651b884e51b0707a66435baa48/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:35.730083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b77b8f0d554798a4f62eef2aa9a76a, user_id=c96d15651b884e51b0707a66435baa48, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:35.734942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:35.756338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1353/2738] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:35 2022] PUT /identity/v3/projects/17b77b8f0d554798a4f62eef2aa9a76a/users/c96d15651b884e51b0707a66435baa48/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:35.764756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfc89-81d5-4bff-8264-4a91cd5e0df2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:35.765525 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfc89-81d5-4bff-8264-4a91cd5e0df2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:35.765813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edfc89-81d5-4bff-8264-4a91cd5e0df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:35.812188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-68edfc89-81d5-4bff-8264-4a91cd5e0df2 None None] MFA Rules not processed for user `c96d15651b884e51b0707a66435baa48`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:35.814069 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-68edfc89-81d5-4bff-8264-4a91cd5e0df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:35.873930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:35.914641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1386/2739] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:35.924191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:35.926075 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:36.009515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6e3a-498d-462e-bfbc-6eb3fa01d881 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:36.017444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:36.018196 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:36.019815 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:36.020194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:36.036944 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fd4d-65a2-4918-8065-4b8a68bf1f44 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:36.037485 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fd4d-65a2-4918-8065-4b8a68bf1f44 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:36.037898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fd4d-65a2-4918-8065-4b8a68bf1f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:36.099268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:36.100934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:36.107828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ad10fd4d-65a2-4918-8065-4b8a68bf1f44 None None] MFA Rules not processed for user `c79f6473093f48b98c91fbcaa320afa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:36.109615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ad10fd4d-65a2-4918-8065-4b8a68bf1f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:36.114428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1354/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:36.224479 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1387/2741] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:32:36.231109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:36.232585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:36.266645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:36.339077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0baa6d-0656-4bf4-aaa8-1e834abfbadc service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:36.345194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:36.346309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:36.346309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:36.346598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:36.348537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:36.417091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:36.418831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:36.429827 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1355/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:39.129691 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86603e6-8def-4419-98cc-751bae64808e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:39.130188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86603e6-8def-4419-98cc-751bae64808e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:39.130447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86603e6-8def-4419-98cc-751bae64808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:39.151247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a86603e6-8def-4419-98cc-751bae64808e None None] MFA Rules not processed for user `7d6d9713a927415d8618bacd76622280`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:39.152477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a86603e6-8def-4419-98cc-751bae64808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:39.166246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1388/2743] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:41.622922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:41.624364 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:41.638229 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8c94f-62ba-476a-9df0-405bfce9783a service nova] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:41.642062 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089cc09-8905-4bdb-bc73-a37ae7e5dd08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:41.642700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089cc09-8905-4bdb-bc73-a37ae7e5dd08 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:41.642983 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089cc09-8905-4bdb-bc73-a37ae7e5dd08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:41.643258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089cc09-8905-4bdb-bc73-a37ae7e5dd08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:41.652914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089cc09-8905-4bdb-bc73-a37ae7e5dd08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:41.654747 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089cc09-8905-4bdb-bc73-a37ae7e5dd08 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:41.664846 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1356/2744] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:47.510087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86603e6-8def-4419-98cc-751bae64808e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:47.575601 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86603e6-8def-4419-98cc-751bae64808e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:47.580138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:47.580861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:47.581176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:47.581452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] PATH_INFO: `/v3/users/cb29b3f5426c40ffbfd039c953fca933` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:47.582578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb29b3f5426c40ffbfd039c953fca933)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:47.585161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:47.805029 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb29b3f5426c40ffbfd039c953fca933'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:47.812557 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb29b3f5426c40ffbfd039c953fca933'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:47.819259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:47.827429 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb29b3f5426c40ffbfd039c953fca933'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:47.910899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb29b3f5426c40ffbfd039c953fca933'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:47.911515 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb29b3f5426c40ffbfd039c953fca933'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:47.918254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1389/2745] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:47 2022] DELETE /identity/v3/users/cb29b3f5426c40ffbfd039c953fca933 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:47.923207 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f0dc-b80f-41d5-91fc-b49fa2d9133f None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:47.923710 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f0dc-b80f-41d5-91fc-b49fa2d9133f None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:47.923824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777f0dc-b80f-41d5-91fc-b49fa2d9133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:47.945702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1777f0dc-b80f-41d5-91fc-b49fa2d9133f None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:47.946933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1777f0dc-b80f-41d5-91fc-b49fa2d9133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:48.007402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1357/2746] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:48.017869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:48.019304 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:48.078812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf8d2-28df-4864-b78d-44bdad03fa57 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:48.082637 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f02985-43cb-458a-aed7-f6824463ef04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:48.083261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02985-43cb-458a-aed7-f6824463ef04 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:48.083619 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02985-43cb-458a-aed7-f6824463ef04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:48.083871 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02985-43cb-458a-aed7-f6824463ef04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:48.093410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f02985-43cb-458a-aed7-f6824463ef04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:48.096764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f02985-43cb-458a-aed7-f6824463ef04 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:48.104670 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1390/2747] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:48.493233 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777f0dc-b80f-41d5-91fc-b49fa2d9133f None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:48.494655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1777f0dc-b80f-41d5-91fc-b49fa2d9133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:48.507237 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777f0dc-b80f-41d5-91fc-b49fa2d9133f None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:48.512281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:48.512987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:48.513243 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:48.513580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] PATH_INFO: `/v3/projects/d2e85a249887473883158908b4bd85e2` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:48.514721 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e85a249887473883158908b4bd85e2)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:48.516684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:48.617841 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:48.624630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e85a249887473883158908b4bd85e2', 'request_id': 'req-8b059ac3-41a2-4dd3-a283-c926122fd2f6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:48.719534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e85a249887473883158908b4bd85e2', 'request_id': 'req-8b059ac3-41a2-4dd3-a283-c926122fd2f6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:48.728524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e85a249887473883158908b4bd85e2', 'request_id': 'req-8b059ac3-41a2-4dd3-a283-c926122fd2f6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:48.739577 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] The token cache is being invalidate because project d2e85a249887473883158908b4bd85e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:48.739868 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:48.740623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:48.742114 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1358/2748] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:48 2022] DELETE /identity/v3/projects/d2e85a249887473883158908b4bd85e2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:32:48.746125 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f02985-43cb-458a-aed7-f6824463ef04 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:48.755878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f02985-43cb-458a-aed7-f6824463ef04 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:48.812343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:48.812973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:48.813257 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:48.813531 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] PATH_INFO: `/v3/users/c96d15651b884e51b0707a66435baa48` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:48.814980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96d15651b884e51b0707a66435baa48)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:48.816979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:48.985660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96d15651b884e51b0707a66435baa48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:48.993078 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96d15651b884e51b0707a66435baa48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.006130 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96d15651b884e51b0707a66435baa48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.076768 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96d15651b884e51b0707a66435baa48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.077460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-5dbbf467-b5ff-4018-b698-57420cfcb736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96d15651b884e51b0707a66435baa48'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.079234 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:49.084901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1391/2749] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:48 2022] DELETE /identity/v3/users/c96d15651b884e51b0707a66435baa48 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:49.515961 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:49.517469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:49.534480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b059ac3-41a2-4dd3-a283-c926122fd2f6 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:49.597246 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:49.597877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:49.598161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:49.598432 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] PATH_INFO: `/v3/projects/17b77b8f0d554798a4f62eef2aa9a76a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:49.599556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b77b8f0d554798a4f62eef2aa9a76a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:49.601702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:49.703935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b77b8f0d554798a4f62eef2aa9a76a', 'request_id': 'req-62f1f587-9d7e-499d-ade6-96bdf4c3287b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.771629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b77b8f0d554798a4f62eef2aa9a76a', 'request_id': 'req-62f1f587-9d7e-499d-ade6-96bdf4c3287b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.778409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b77b8f0d554798a4f62eef2aa9a76a', 'request_id': 'req-62f1f587-9d7e-499d-ade6-96bdf4c3287b'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.789275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] The token cache is being invalidate because project 17b77b8f0d554798a4f62eef2aa9a76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:49.789567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.790232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-62f1f587-9d7e-499d-ade6-96bdf4c3287b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:49.791718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1359/2750] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:49 2022] DELETE /identity/v3/projects/17b77b8f0d554798a4f62eef2aa9a76a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:32:49.797570 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85836b15-f966-4e3e-9133-82a9bc5c0a1e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:49.798091 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85836b15-f966-4e3e-9133-82a9bc5c0a1e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:49.798193 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85836b15-f966-4e3e-9133-82a9bc5c0a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:49.820559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-85836b15-f966-4e3e-9133-82a9bc5c0a1e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:49.821788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-85836b15-f966-4e3e-9133-82a9bc5c0a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:49.887446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1392/2751] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:49.898046 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf2dd-5a97-4c54-aa04-4163cecc4091 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:49.898303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf2dd-5a97-4c54-aa04-4163cecc4091 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:49.898678 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecf2dd-5a97-4c54-aa04-4163cecc4091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:49.918903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-48ecf2dd-5a97-4c54-aa04-4163cecc4091 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:49.920109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-48ecf2dd-5a97-4c54-aa04-4163cecc4091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:49.928978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1360/2752] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:49.933395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85836b15-f966-4e3e-9133-82a9bc5c0a1e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:49.943365 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85836b15-f966-4e3e-9133-82a9bc5c0a1e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:49.948587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:49.949210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:49.949537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:49.949815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:49.950492 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:49.950799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:49.952470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:49.964087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1393/2753] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:49.968568 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf2dd-5a97-4c54-aa04-4163cecc4091 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:49.978821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecf2dd-5a97-4c54-aa04-4163cecc4091 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:49.983630 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5aa14-962a-47eb-8124-317b66f4c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:49.984238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5aa14-962a-47eb-8124-317b66f4c33c admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:49.984541 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5aa14-962a-47eb-8124-317b66f4c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:49.984814 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5aa14-962a-47eb-8124-317b66f4c33c admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:49.985466 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5aa14-962a-47eb-8124-317b66f4c33c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:49.987396 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5aa14-962a-47eb-8124-317b66f4c33c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:50.073401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1361/2754] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:49 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:50.078210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:50.088832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dc283-bd21-4a22-b754-49ec7345b3dc admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:50.145611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e575f-3e77-4e36-aa96-5711d723201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:50.146262 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e575f-3e77-4e36-aa96-5711d723201d admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:50.146550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e575f-3e77-4e36-aa96-5711d723201d admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:50.146827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e575f-3e77-4e36-aa96-5711d723201d admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:50.147474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e575f-3e77-4e36-aa96-5711d723201d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:50.149436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e575f-3e77-4e36-aa96-5711d723201d admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:50.226514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1394/2755] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:50 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:50.230745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5aa14-962a-47eb-8124-317b66f4c33c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:50.241140 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5aa14-962a-47eb-8124-317b66f4c33c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:50.245775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617a2b0-a46a-40cd-a46f-358d8532f3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:50.246373 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a2b0-a46a-40cd-a46f-358d8532f3cc admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:50.246648 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a2b0-a46a-40cd-a46f-358d8532f3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:50.246919 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617a2b0-a46a-40cd-a46f-358d8532f3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:50.247560 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617a2b0-a46a-40cd-a46f-358d8532f3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:50.249198 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617a2b0-a46a-40cd-a46f-358d8532f3cc admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:50.259286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1362/2756] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:50.263386 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e575f-3e77-4e36-aa96-5711d723201d admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:50.274287 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e575f-3e77-4e36-aa96-5711d723201d admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:50.278946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e236a-af02-408b-b063-73f84c7ef6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:50.279538 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e236a-af02-408b-b063-73f84c7ef6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:50.279818 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e236a-af02-408b-b063-73f84c7ef6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:50.280097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e236a-af02-408b-b063-73f84c7ef6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:50.280836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e236a-af02-408b-b063-73f84c7ef6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:50.282422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e236a-af02-408b-b063-73f84c7ef6d8 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:50.293788 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1395/2757] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:50.306667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617a2b0-a46a-40cd-a46f-358d8532f3cc admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:50.307764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617a2b0-a46a-40cd-a46f-358d8532f3cc admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:50.312640 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:50.313005 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:50.313281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:50.313554 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] PATH_INFO: `/v3/projects/6044ed983b9e42478ee5f41ff09714b2/users/bdecda0603dd479ab5a2a582497d3aeb/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:50.328406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6044ed983b9e42478ee5f41ff09714b2, user_id=bdecda0603dd479ab5a2a582497d3aeb, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:50.330990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:50.333152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:50.405863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1363/2758] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:50 2022] PUT /identity/v3/projects/6044ed983b9e42478ee5f41ff09714b2/users/bdecda0603dd479ab5a2a582497d3aeb/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:50.417589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdcee7-dd1c-421d-90bb-04ffef8a0375 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:50.417876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdcee7-dd1c-421d-90bb-04ffef8a0375 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:50.418149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdcee7-dd1c-421d-90bb-04ffef8a0375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:50.445172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-fdbdcee7-dd1c-421d-90bb-04ffef8a0375 None None] MFA Rules not processed for user `bdecda0603dd479ab5a2a582497d3aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:50.446387 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fdbdcee7-dd1c-421d-90bb-04ffef8a0375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:50.500899 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:50.517913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1396/2759] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:50.524253 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:50.526086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:50.585428 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65321-8faa-4a4e-aea2-b059a79beb5c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:50.588987 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2743-99b8-4d7f-af22-fa9527667486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:50.589714 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2743-99b8-4d7f-af22-fa9527667486 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:50.590034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2743-99b8-4d7f-af22-fa9527667486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:50.590305 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a2743-99b8-4d7f-af22-fa9527667486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:50.598446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a2743-99b8-4d7f-af22-fa9527667486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:50.600343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a2743-99b8-4d7f-af22-fa9527667486 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:50.609292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1364/2760] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:54.043093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdcee7-dd1c-421d-90bb-04ffef8a0375 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:54.044657 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fdbdcee7-dd1c-421d-90bb-04ffef8a0375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:54.103574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdcee7-dd1c-421d-90bb-04ffef8a0375 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:54.107112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612069dc-4527-49bc-970f-359b519a4189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:54.107710 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612069dc-4527-49bc-970f-359b519a4189 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:54.108045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612069dc-4527-49bc-970f-359b519a4189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:54.108347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612069dc-4527-49bc-970f-359b519a4189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:54.112168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-612069dc-4527-49bc-970f-359b519a4189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:54.120672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612069dc-4527-49bc-970f-359b519a4189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:54.122081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612069dc-4527-49bc-970f-359b519a4189 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:54.130422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1397/2761] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:54.927281 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2743-99b8-4d7f-af22-fa9527667486 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:54.990300 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a2743-99b8-4d7f-af22-fa9527667486 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:54.995002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:54.995620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:54.995900 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:54.996173 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] PATH_INFO: `/v3/users/bdecda0603dd479ab5a2a582497d3aeb` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:54.997335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdecda0603dd479ab5a2a582497d3aeb)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:54.999250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:55.218993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdecda0603dd479ab5a2a582497d3aeb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:55.226310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdecda0603dd479ab5a2a582497d3aeb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:55.296327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdecda0603dd479ab5a2a582497d3aeb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:55.308135 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdecda0603dd479ab5a2a582497d3aeb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:55.308791 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdecda0603dd479ab5a2a582497d3aeb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:55.314693 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1365/2762] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:32:54 2022] DELETE /identity/v3/users/bdecda0603dd479ab5a2a582497d3aeb => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:55.319204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14715ffa-fb9d-4b65-b12d-a38e143d9100 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:55.320437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14715ffa-fb9d-4b65-b12d-a38e143d9100 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:55.320437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14715ffa-fb9d-4b65-b12d-a38e143d9100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:55.339945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-14715ffa-fb9d-4b65-b12d-a38e143d9100 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:55.341187 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-14715ffa-fb9d-4b65-b12d-a38e143d9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:55.400163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1398/2763] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:55.409820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:55.411217 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:55.429947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:55.468277 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41093-cdfe-4fc0-a127-d1ff8b8d75ab admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:55.471883 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d8269-a747-4156-890e-34e4116d2535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:55.472514 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8269-a747-4156-890e-34e4116d2535 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:55.472796 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8269-a747-4156-890e-34e4116d2535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:55.473067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8269-a747-4156-890e-34e4116d2535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:55.482132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d8269-a747-4156-890e-34e4116d2535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:55.483573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d8269-a747-4156-890e-34e4116d2535 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:55.494147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1366/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:32:55.962016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14715ffa-fb9d-4b65-b12d-a38e143d9100 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:55.965482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-14715ffa-fb9d-4b65-b12d-a38e143d9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:55.978929 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14715ffa-fb9d-4b65-b12d-a38e143d9100 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:55.984201 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:55.985080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:55.985447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:55.985782 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] PATH_INFO: `/v3/projects/6044ed983b9e42478ee5f41ff09714b2` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:55.987149 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6044ed983b9e42478ee5f41ff09714b2)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:55.991075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:56.091776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6044ed983b9e42478ee5f41ff09714b2', 'request_id': 'req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:56.098004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6044ed983b9e42478ee5f41ff09714b2', 'request_id': 'req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:56.104480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6044ed983b9e42478ee5f41ff09714b2', 'request_id': 'req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:56.178926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] The token cache is being invalidate because project 6044ed983b9e42478ee5f41ff09714b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:32:56.179241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:56.179995 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-71cfbd45-83ce-40e0-997e-d6dbf1a7f001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:32:56.181608 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1399/2765] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:32:55 2022] DELETE /identity/v3/projects/6044ed983b9e42478ee5f41ff09714b2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:56.186895 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5a62-34e9-4fae-826e-71d8af82444b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.187361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5a62-34e9-4fae-826e-71d8af82444b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.187479 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c5a62-34e9-4fae-826e-71d8af82444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.207003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-887c5a62-34e9-4fae-826e-71d8af82444b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:56.208204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-887c5a62-34e9-4fae-826e-71d8af82444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:56.268946 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1367/2766] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:56.277323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb71e-731c-48cc-bdec-1b98d184adb7 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.277609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb71e-731c-48cc-bdec-1b98d184adb7 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.277888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb71e-731c-48cc-bdec-1b98d184adb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.297822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-081cb71e-731c-48cc-bdec-1b98d184adb7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:56.299016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-081cb71e-731c-48cc-bdec-1b98d184adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:56.307151 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1400/2767] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:56.314995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c5a62-34e9-4fae-826e-71d8af82444b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:56.326068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c5a62-34e9-4fae-826e-71d8af82444b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:56.330785 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:56.331393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.331670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.331943 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.332925 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:32:56.333236 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:56.337635 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:56.347667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1368/2768] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:32:56.352973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb71e-731c-48cc-bdec-1b98d184adb7 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:56.362194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb71e-731c-48cc-bdec-1b98d184adb7 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:56.366992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf49a3-ef88-4215-9cc3-4f2ec66af9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:56.367583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf49a3-ef88-4215-9cc3-4f2ec66af9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.367861 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf49a3-ef88-4215-9cc3-4f2ec66af9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.368131 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf49a3-ef88-4215-9cc3-4f2ec66af9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.368832 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf49a3-ef88-4215-9cc3-4f2ec66af9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:56.370734 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf49a3-ef88-4215-9cc3-4f2ec66af9d7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:56.381847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:56.475191 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1401/2769] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:32:56 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:56.479248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:56.489702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8cf00-1cc5-416d-a697-b4f1657c4577 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:56.548168 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb2f8c-dad7-444a-8565-4d41406befbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:56.548794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb2f8c-dad7-444a-8565-4d41406befbb admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.549072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb2f8c-dad7-444a-8565-4d41406befbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.549380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb2f8c-dad7-444a-8565-4d41406befbb admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.550014 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb2f8c-dad7-444a-8565-4d41406befbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:56.551982 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb2f8c-dad7-444a-8565-4d41406befbb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:56.623063 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1369/2770] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:32:56 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:32:56.627009 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf49a3-ef88-4215-9cc3-4f2ec66af9d7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:56.638005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf49a3-ef88-4215-9cc3-4f2ec66af9d7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:56.642669 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751546cd-27c5-471e-ae59-ee5a5e8e71ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:56.643261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751546cd-27c5-471e-ae59-ee5a5e8e71ba admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.643539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751546cd-27c5-471e-ae59-ee5a5e8e71ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.643843 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751546cd-27c5-471e-ae59-ee5a5e8e71ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.644897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751546cd-27c5-471e-ae59-ee5a5e8e71ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:56.646477 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751546cd-27c5-471e-ae59-ee5a5e8e71ba admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:56.657640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1402/2771] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:56.661680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb2f8c-dad7-444a-8565-4d41406befbb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:56.673922 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb2f8c-dad7-444a-8565-4d41406befbb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:56.678715 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6a62c-5fcd-485b-a074-2e0506fa1668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:56.680222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6a62c-5fcd-485b-a074-2e0506fa1668 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.680222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6a62c-5fcd-485b-a074-2e0506fa1668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.680222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6a62c-5fcd-485b-a074-2e0506fa1668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.680662 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6a62c-5fcd-485b-a074-2e0506fa1668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:56.682156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6a62c-5fcd-485b-a074-2e0506fa1668 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:56.692893 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1370/2772] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:32:56.697554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751546cd-27c5-471e-ae59-ee5a5e8e71ba admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:56.707684 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751546cd-27c5-471e-ae59-ee5a5e8e71ba admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:56.714112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:56.714112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.714112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.714453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] PATH_INFO: `/v3/projects/3019c70c2aef4bfca3d68ca2e2258876/users/eff10525ba8a4240a2dd767ca1a8f531/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.728592 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3019c70c2aef4bfca3d68ca2e2258876, user_id=eff10525ba8a4240a2dd767ca1a8f531, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:56.731177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:56.834655 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1403/2773] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:32:56 2022] PUT /identity/v3/projects/3019c70c2aef4bfca3d68ca2e2258876/users/eff10525ba8a4240a2dd767ca1a8f531/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:32:56.845310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e103-3029-4721-b7bc-77b56c73d859 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:56.846745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e103-3029-4721-b7bc-77b56c73d859 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:56.846745 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e103-3029-4721-b7bc-77b56c73d859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:56.873462 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-10e9e103-3029-4721-b7bc-77b56c73d859 None None] MFA Rules not processed for user `eff10525ba8a4240a2dd767ca1a8f531`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:32:56.875378 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-10e9e103-3029-4721-b7bc-77b56c73d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:56.887427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:32:56.941427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1371/2774] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:32:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:32:56.955040 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:32:56.961453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:32:57.022470 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7870e4e-cc29-4e87-a527-e1378f5e67c4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:32:57.026706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff52bc-9170-4d53-85ca-74fca3720f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:32:57.027317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff52bc-9170-4d53-85ca-74fca3720f33 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:32:57.027596 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff52bc-9170-4d53-85ca-74fca3720f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:32:57.027867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff52bc-9170-4d53-85ca-74fca3720f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:32:57.036215 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff52bc-9170-4d53-85ca-74fca3720f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:32:57.037664 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff52bc-9170-4d53-85ca-74fca3720f33 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:32:57.046934 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1404/2775] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:32:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:33:03.013033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9e103-3029-4721-b7bc-77b56c73d859 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:33:03.073849 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9e103-3029-4721-b7bc-77b56c73d859 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:33:03.078325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:33:03.078954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:33:03.079232 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:33:03.079507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] PATH_INFO: `/v3/users/eff10525ba8a4240a2dd767ca1a8f531` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:33:03.080659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff10525ba8a4240a2dd767ca1a8f531)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:33:03.082594 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:33:03.266995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff10525ba8a4240a2dd767ca1a8f531'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:03.274455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff10525ba8a4240a2dd767ca1a8f531'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:03.333486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff10525ba8a4240a2dd767ca1a8f531'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:03.346476 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff10525ba8a4240a2dd767ca1a8f531'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:03.347118 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff10525ba8a4240a2dd767ca1a8f531'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:03.353496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1372/2776] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:33:03 2022] DELETE /identity/v3/users/eff10525ba8a4240a2dd767ca1a8f531 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:33:03.357695 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861ffc9-ed8a-4cb5-8e4a-955961a2aaf2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:33:03.358185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861ffc9-ed8a-4cb5-8e4a-955961a2aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:33:03.358367 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861ffc9-ed8a-4cb5-8e4a-955961a2aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:33:03.377169 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-4861ffc9-ed8a-4cb5-8e4a-955961a2aaf2 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:33:03.379413 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4861ffc9-ed8a-4cb5-8e4a-955961a2aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:33:03.436527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1405/2777] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:33:03.446835 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:33:03.448346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:33:03.483764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:33:03.504402 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d0004-aeb3-4d2c-bec0-44da1778a3d9 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:33:03.509226 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e681ab-7c36-4e7f-b9ed-6ff9fe40fff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:33:03.509825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e681ab-7c36-4e7f-b9ed-6ff9fe40fff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:33:03.510102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e681ab-7c36-4e7f-b9ed-6ff9fe40fff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:33:03.510372 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e681ab-7c36-4e7f-b9ed-6ff9fe40fff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:33:03.519677 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e681ab-7c36-4e7f-b9ed-6ff9fe40fff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:33:03.521146 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e681ab-7c36-4e7f-b9ed-6ff9fe40fff2 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:33:03.531142 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1373/2778] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:33:04.008511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861ffc9-ed8a-4cb5-8e4a-955961a2aaf2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:33:04.010347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4861ffc9-ed8a-4cb5-8e4a-955961a2aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:33:04.024147 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861ffc9-ed8a-4cb5-8e4a-955961a2aaf2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:33:04.028863 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:33:04.029509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:33:04.029777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:33:04.030050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] PATH_INFO: `/v3/projects/3019c70c2aef4bfca3d68ca2e2258876` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:33:04.032062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3019c70c2aef4bfca3d68ca2e2258876)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:33:04.034016 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:33:04.137815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3019c70c2aef4bfca3d68ca2e2258876', 'request_id': 'req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:04.144084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3019c70c2aef4bfca3d68ca2e2258876', 'request_id': 'req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:04.145339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:33:04.150249 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3019c70c2aef4bfca3d68ca2e2258876', 'request_id': 'req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:04.233068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] The token cache is being invalidate because project 3019c70c2aef4bfca3d68ca2e2258876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:33:04.233361 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:04.233999 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-2bba86cc-f2b1-4e5d-9aa9-d0cfc4ca6096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:33:04.235555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1406/2779] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:33:04 2022] DELETE /identity/v3/projects/3019c70c2aef4bfca3d68ca2e2258876 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:33:10.243535 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e681ab-7c36-4e7f-b9ed-6ff9fe40fff2 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:33:10.252712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e681ab-7c36-4e7f-b9ed-6ff9fe40fff2 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:33:10.308187 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:33:10.308865 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:33:10.309144 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:33:10.309414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:33:10.311366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:33:10.380081 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:33:10.381599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:33:10.393342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1374/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:33:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:33:14.329185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d039-8eb1-40aa-be6a-bbc9389d0bf6 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:33:14.329666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d039-8eb1-40aa-be6a-bbc9389d0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:33:14.330702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2d039-8eb1-40aa-be6a-bbc9389d0bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:33:14.348440 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-52d2d039-8eb1-40aa-be6a-bbc9389d0bf6 None None] MFA Rules not processed for user `ab42e078660a4b5d878aeec160c33123`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:33:14.349646 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-52d2d039-8eb1-40aa-be6a-bbc9389d0bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:33:14.405273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1407/2781] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:33:20.388513 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=61 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:33:24.398678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:DELETE=3,keystone:SELECT=29,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:33:31.525792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:33:31.527297 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:33:31.616417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d2e51-c625-4171-ae13-515f6f9cae0f service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:33:31.621587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:33:31.622188 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:33:31.622468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:33:31.622737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:33:31.624489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:33:31.635751 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:33:31.638227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:33:31.647844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1375/2782] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:33:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:33:41.643736 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=41 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:34:19.639912 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da104f0-9d84-4d0d-89fd-e16226e74754 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:19.640446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da104f0-9d84-4d0d-89fd-e16226e74754 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:19.640563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da104f0-9d84-4d0d-89fd-e16226e74754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:19.670799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-1da104f0-9d84-4d0d-89fd-e16226e74754 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:34:19.671985 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1da104f0-9d84-4d0d-89fd-e16226e74754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:19.734160 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1408/2783] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:34:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:34:19.871172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:34:19.872706 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:19.947009 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac4fed-07e5-4467-abec-d906780ecb5e service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:34:19.953863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c78bc-9679-42a8-a2d7-cad59439dca9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:34:19.955023 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c78bc-9679-42a8-a2d7-cad59439dca9 service swift] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:19.955309 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c78bc-9679-42a8-a2d7-cad59439dca9 service swift] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:19.955586 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c78bc-9679-42a8-a2d7-cad59439dca9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:19.965845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c78bc-9679-42a8-a2d7-cad59439dca9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:34:19.967440 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c78bc-9679-42a8-a2d7-cad59439dca9 service swift] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:34:19.977125 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1376/2784] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 10:34:29.727682 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=32 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:34:29.973775 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=32 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:34:36.400761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3665b-8b4d-4300-97eb-f292d271442f None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:36.401301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3665b-8b4d-4300-97eb-f292d271442f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:36.401301 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3665b-8b4d-4300-97eb-f292d271442f None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:36.402909 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1409/2785] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:34:36.408575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee033b2-d2c3-47da-adb9-81a65336b881 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:36.409017 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee033b2-d2c3-47da-adb9-81a65336b881 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:36.409379 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee033b2-d2c3-47da-adb9-81a65336b881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:36.457416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-aee033b2-d2c3-47da-adb9-81a65336b881 None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:34:36.458692 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-aee033b2-d2c3-47da-adb9-81a65336b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:36.533547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1377/2786] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:34:36.544828 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3665b-8b4d-4300-97eb-f292d271442f None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:34:36.546636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-3cd3665b-8b4d-4300-97eb-f292d271442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:36.603873 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3665b-8b4d-4300-97eb-f292d271442f None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:34:36.607426 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5302e-4d7d-44b0-9f1c-c647dc63da73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00283447a1a6405b952e541a13c91110', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:34:36.608021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5302e-4d7d-44b0-9f1c-c647dc63da73 service glance] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:36.608321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5302e-4d7d-44b0-9f1c-c647dc63da73 service glance] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:36.608602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5302e-4d7d-44b0-9f1c-c647dc63da73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:36.619080 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5302e-4d7d-44b0-9f1c-c647dc63da73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:34:36.620522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5302e-4d7d-44b0-9f1c-c647dc63da73 service glance] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:34:36.631952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1410/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:34:36.828230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57e75-223a-4e82-9e82-a910bf911d42 None None] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:36.828588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57e75-223a-4e82-9e82-a910bf911d42 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:36.828872 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57e75-223a-4e82-9e82-a910bf911d42 None None] PATH_INFO: `/` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:36.830270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1378/2788] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:34:36.835385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6211ae-b29e-4d6a-93af-b97d66a5f31f None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:36.835674 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6211ae-b29e-4d6a-93af-b97d66a5f31f None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:36.836494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6211ae-b29e-4d6a-93af-b97d66a5f31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:36.868989 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-9c6211ae-b29e-4d6a-93af-b97d66a5f31f None None] MFA Rules not processed for user `757ad5baa909451d94dd1eced0407d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:34:36.870177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-9c6211ae-b29e-4d6a-93af-b97d66a5f31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:36.876975 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1411/2789] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:34:36.888737 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57e75-223a-4e82-9e82-a910bf911d42 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:34:36.890483 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-86a57e75-223a-4e82-9e82-a910bf911d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:36.903959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57e75-223a-4e82-9e82-a910bf911d42 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:34:36.908335 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e70928-3300-4283-b05c-da8aa78aa6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:34:36.908930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70928-3300-4283-b05c-da8aa78aa6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:36.909203 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70928-3300-4283-b05c-da8aa78aa6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:36.909470 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e70928-3300-4283-b05c-da8aa78aa6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:36.916245 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e70928-3300-4283-b05c-da8aa78aa6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:34:36.917691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e70928-3300-4283-b05c-da8aa78aa6b2 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:34:36.926239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1379/2790] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:34:37.007947 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894da1-f9c6-44bf-afc0-9b12e316e89e None None] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:37.008328 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894da1-f9c6-44bf-afc0-9b12e316e89e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:37.008614 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c894da1-f9c6-44bf-afc0-9b12e316e89e None None] PATH_INFO: `/` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:37.010006 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1412/2791] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 28 10:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 10:34:37.015271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dff592-1bb2-4c23-86eb-2ae53bf04d42 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:37.015553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dff592-1bb2-4c23-86eb-2ae53bf04d42 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:37.015952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dff592-1bb2-4c23-86eb-2ae53bf04d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:37.035988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d4dff592-1bb2-4c23-86eb-2ae53bf04d42 None None] MFA Rules not processed for user `7e8ce142e0c944b49053bd2a44ce4853`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:34:37.037240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d4dff592-1bb2-4c23-86eb-2ae53bf04d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:37.046316 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1380/2792] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 28 10:34:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:34:37.056780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c894da1-f9c6-44bf-afc0-9b12e316e89e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:34:37.058448 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4c894da1-f9c6-44bf-afc0-9b12e316e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:37.072087 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c894da1-f9c6-44bf-afc0-9b12e316e89e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:34:37.075639 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137489d-64ea-4e3f-81cf-fa9deb980b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:34:37.076219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137489d-64ea-4e3f-81cf-fa9deb980b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:37.076573 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137489d-64ea-4e3f-81cf-fa9deb980b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:37.076847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137489d-64ea-4e3f-81cf-fa9deb980b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:37.087661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137489d-64ea-4e3f-81cf-fa9deb980b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:34:37.089045 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137489d-64ea-4e3f-81cf-fa9deb980b70 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:34:37.099521 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1413/2793] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:34:39.366740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173d77-56fb-420b-903a-17633449a84b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:39.367214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173d77-56fb-420b-903a-17633449a84b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:39.367324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3173d77-56fb-420b-903a-17633449a84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:39.386366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a3173d77-56fb-420b-903a-17633449a84b None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:34:39.387543 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a3173d77-56fb-420b-903a-17633449a84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:39.395078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1381/2794] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:34:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:34:39.407510 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137489d-64ea-4e3f-81cf-fa9deb980b70 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:34:39.418797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137489d-64ea-4e3f-81cf-fa9deb980b70 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:34:39.423883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89659c-9f21-4234-a464-66d0df9d9aad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:34:39.424506 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89659c-9f21-4234-a464-66d0df9d9aad service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:39.424822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89659c-9f21-4234-a464-66d0df9d9aad service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:39.425099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89659c-9f21-4234-a464-66d0df9d9aad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:39.433064 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89659c-9f21-4234-a464-66d0df9d9aad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:34:39.434641 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89659c-9f21-4234-a464-66d0df9d9aad service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:34:39.442745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1414/2795] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:34:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:34:49.381592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=56 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:34:49.439463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=46 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:34:53.958413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1498e0b-d07c-496b-8865-f1bbe7792f16 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:53.958878 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1498e0b-d07c-496b-8865-f1bbe7792f16 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:53.958984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1498e0b-d07c-496b-8865-f1bbe7792f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:53.978270 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b1498e0b-d07c-496b-8865-f1bbe7792f16 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:34:53.979469 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b1498e0b-d07c-496b-8865-f1bbe7792f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:34:53.987171 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1382/2796] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:34:53.999068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89659c-9f21-4234-a464-66d0df9d9aad service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:34:54.009851 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89659c-9f21-4234-a464-66d0df9d9aad service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:34:54.014882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9486cee-46ba-43b2-b012-b24a6aa905ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:34:54.015474 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9486cee-46ba-43b2-b012-b24a6aa905ea service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:34:54.015756 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9486cee-46ba-43b2-b012-b24a6aa905ea service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:34:54.016030 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9486cee-46ba-43b2-b012-b24a6aa905ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:34:54.023981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9486cee-46ba-43b2-b012-b24a6aa905ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:34:54.025589 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9486cee-46ba-43b2-b012-b24a6aa905ea service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:34:54.033978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1415/2797] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:34:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:35:03.973643 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:04.030219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=6 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:21.795923 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1498e0b-d07c-496b-8865-f1bbe7792f16 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:21.805323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1498e0b-d07c-496b-8865-f1bbe7792f16 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:21.809801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:21.809801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:21.809801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:21.810132 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:21.811665 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:21.826150 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:21.828221 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:21.845056 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1383/2798] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:35:25.631034 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9486cee-46ba-43b2-b012-b24a6aa905ea service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:25.640437 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9486cee-46ba-43b2-b012-b24a6aa905ea service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:25.644849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:25.645441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:25.645721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:25.646000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:25.647715 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:25.661105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:25.662555 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:25.673331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1416/2799] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 10:35:31.839450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=6 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:31.894575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:31.903223 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80e2c-22bc-4e38-bf4c-74dd2a3123ea service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:31.906916 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:31.907522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:31.907804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:31.908112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:31.909897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:31.972764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:31.974191 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:31.983510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1384/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:35:35.426932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:35.428445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:35.442836 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c19f2-d7c1-42ff-aaae-52d4f226b539 service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:35.448020 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:35.448640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:35.448924 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:35.449245 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:35.450936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:35.462571 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:35.465697 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:35.475048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1417/2801] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:35:35.522972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:35.524454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:35.537474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46013a-4c62-41ad-8914-93d010c434b3 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:35.542437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:35.543068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:35.543386 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:35.543664 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] PATH_INFO: `/v3/users/ab42e078660a4b5d878aeec160c33123` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:35.544924 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab42e078660a4b5d878aeec160c33123)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:35.546903 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:35.671565 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab42e078660a4b5d878aeec160c33123'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:35.679824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab42e078660a4b5d878aeec160c33123'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:35.749096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab42e078660a4b5d878aeec160c33123'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:35.762409 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab42e078660a4b5d878aeec160c33123'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:35.763055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-702cad0d-e611-43e8-89d4-b289222c3a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab42e078660a4b5d878aeec160c33123'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:35.769225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1385/2802] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:35:35 2022] DELETE /identity/v3/users/ab42e078660a4b5d878aeec160c33123 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:36.013874 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:36.027666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5730bf-b75e-486e-9b4a-563dab3e9974 service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:36.087026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:36.087696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.087980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.088254 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] PATH_INFO: `/v3/projects/10b6c71a479a4521ae3286b3b7432513` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.089409 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b6c71a479a4521ae3286b3b7432513)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:36.091319 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:36.198752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b6c71a479a4521ae3286b3b7432513', 'request_id': 'req-4dc86efe-a3ae-4663-aa71-80818022652a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:36.206337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b6c71a479a4521ae3286b3b7432513', 'request_id': 'req-4dc86efe-a3ae-4663-aa71-80818022652a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:36.212238 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b6c71a479a4521ae3286b3b7432513', 'request_id': 'req-4dc86efe-a3ae-4663-aa71-80818022652a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:36.282296 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] The token cache is being invalidate because project 10b6c71a479a4521ae3286b3b7432513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:35:36.282588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:36.283338 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-4dc86efe-a3ae-4663-aa71-80818022652a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:36.284886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1418/2803] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:35:36 2022] DELETE /identity/v3/projects/10b6c71a479a4521ae3286b3b7432513 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:36.290012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0543-e895-490f-b213-b84a5cb2d9d7 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.290303 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0543-e895-490f-b213-b84a5cb2d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.290583 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0543-e895-490f-b213-b84a5cb2d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.338914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-249a0543-e895-490f-b213-b84a5cb2d9d7 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:36.340165 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-249a0543-e895-490f-b213-b84a5cb2d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:36.390275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:36.409465 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1386/2804] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:36.417164 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e06b8-874e-4634-a740-de120749a252 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.417442 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e06b8-874e-4634-a740-de120749a252 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.417712 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e06b8-874e-4634-a740-de120749a252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.437960 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-086e06b8-874e-4634-a740-de120749a252 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:36.439757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-086e06b8-874e-4634-a740-de120749a252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:36.447587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1419/2805] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:36.451879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0543-e895-490f-b213-b84a5cb2d9d7 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:36.461844 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0543-e895-490f-b213-b84a5cb2d9d7 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:36.466517 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:36.467111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.467385 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.467654 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.468319 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:35:36.468627 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:36.470261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:36.481966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1387/2806] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:35:36.487018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e06b8-874e-4634-a740-de120749a252 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:36.496159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e06b8-874e-4634-a740-de120749a252 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:36.500824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c57f01-f187-4a96-b73f-60e55b4c02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:36.501414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57f01-f187-4a96-b73f-60e55b4c02c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.502395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57f01-f187-4a96-b73f-60e55b4c02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.502876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c57f01-f187-4a96-b73f-60e55b4c02c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.503527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c57f01-f187-4a96-b73f-60e55b4c02c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:36.505703 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c57f01-f187-4a96-b73f-60e55b4c02c4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:36.614513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1420/2807] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:35:36 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:36.618673 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:36.629769 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527180b-ea0a-4df8-82ac-2f58bc20683a admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:36.687809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93019f6-b994-44e9-a520-30d77ced5211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:36.688437 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93019f6-b994-44e9-a520-30d77ced5211 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.688719 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93019f6-b994-44e9-a520-30d77ced5211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.689104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93019f6-b994-44e9-a520-30d77ced5211 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.690607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93019f6-b994-44e9-a520-30d77ced5211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:36.692566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93019f6-b994-44e9-a520-30d77ced5211 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:36.790461 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1388/2808] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:35:36 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:36.794642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c57f01-f187-4a96-b73f-60e55b4c02c4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:36.805587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c57f01-f187-4a96-b73f-60e55b4c02c4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:36.810197 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e653-f5e5-4921-898c-0e605d605dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:36.810789 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e653-f5e5-4921-898c-0e605d605dad admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.811070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e653-f5e5-4921-898c-0e605d605dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.811340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e653-f5e5-4921-898c-0e605d605dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.811979 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0e653-f5e5-4921-898c-0e605d605dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:36.813658 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0e653-f5e5-4921-898c-0e605d605dad admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:36.823520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1421/2809] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:35:36.827631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93019f6-b994-44e9-a520-30d77ced5211 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:36.837799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93019f6-b994-44e9-a520-30d77ced5211 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:36.842416 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dde7b2-730e-4e43-8c98-2007b96483ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:36.843013 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde7b2-730e-4e43-8c98-2007b96483ee admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.843292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde7b2-730e-4e43-8c98-2007b96483ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.843567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde7b2-730e-4e43-8c98-2007b96483ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.844242 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dde7b2-730e-4e43-8c98-2007b96483ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:36.846431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dde7b2-730e-4e43-8c98-2007b96483ee admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:36.856907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1389/2810] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:35:36.861686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e653-f5e5-4921-898c-0e605d605dad admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:36.871550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e653-f5e5-4921-898c-0e605d605dad admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:36.876097 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:36.876901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.877179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.877453 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] PATH_INFO: `/v3/projects/a88ac3131d1b47f38ad98abdf85a65aa/users/75bf993e7ff545d8944a5a2e8be39c2c/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.889586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:36.892586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a88ac3131d1b47f38ad98abdf85a65aa, user_id=75bf993e7ff545d8944a5a2e8be39c2c, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:36.895252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:36.955273 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1422/2811] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:35:36 2022] PUT /identity/v3/projects/a88ac3131d1b47f38ad98abdf85a65aa/users/75bf993e7ff545d8944a5a2e8be39c2c/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:36.965675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3517178-ec5f-4a64-a147-3fc6cc4232d2 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:36.965960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3517178-ec5f-4a64-a147-3fc6cc4232d2 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:36.966238 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3517178-ec5f-4a64-a147-3fc6cc4232d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:36.994275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-a3517178-ec5f-4a64-a147-3fc6cc4232d2 None None] MFA Rules not processed for user `75bf993e7ff545d8944a5a2e8be39c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:36.995480 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a3517178-ec5f-4a64-a147-3fc6cc4232d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:37.057941 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1390/2812] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:37.069014 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:37.071031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:37.150737 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf682f77-2c07-4496-aadd-b21ef91422b4 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:37.154495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc6391-be8f-431f-bbcd-81c616210586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:37.155101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc6391-be8f-431f-bbcd-81c616210586 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:37.155384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc6391-be8f-431f-bbcd-81c616210586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:37.155659 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc6391-be8f-431f-bbcd-81c616210586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:37.164824 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc6391-be8f-431f-bbcd-81c616210586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:37.166229 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc6391-be8f-431f-bbcd-81c616210586 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:37.175188 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1423/2813] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:35:46.742095 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3517178-ec5f-4a64-a147-3fc6cc4232d2 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:46.783361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:46.804065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3517178-ec5f-4a64-a147-3fc6cc4232d2 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:46.808690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:46.809318 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:46.809599 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:46.809874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] PATH_INFO: `/v3/users/75bf993e7ff545d8944a5a2e8be39c2c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:46.811007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bf993e7ff545d8944a5a2e8be39c2c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:46.813001 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:46.985969 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bf993e7ff545d8944a5a2e8be39c2c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:46.992873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bf993e7ff545d8944a5a2e8be39c2c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.051981 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bf993e7ff545d8944a5a2e8be39c2c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.064192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bf993e7ff545d8944a5a2e8be39c2c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.065273 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bf993e7ff545d8944a5a2e8be39c2c'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.071079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1391/2814] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:35:46 2022] DELETE /identity/v3/users/75bf993e7ff545d8944a5a2e8be39c2c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:47.075799 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5e61-9e11-4b1b-8ae7-0fe047da44b4 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:47.078559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5e61-9e11-4b1b-8ae7-0fe047da44b4 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:47.078559 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d5e61-9e11-4b1b-8ae7-0fe047da44b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:47.095482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-223d5e61-9e11-4b1b-8ae7-0fe047da44b4 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:47.097345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-223d5e61-9e11-4b1b-8ae7-0fe047da44b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:47.156051 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1424/2815] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:47.166530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:47.167957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:47.231478 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8736723-5555-47a7-b8c4-af8c4f697a86 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:47.235325 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9fcb7-de7e-45f2-acb3-8931d1397baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:47.236040 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fcb7-de7e-45f2-acb3-8931d1397baf service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:47.236266 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fcb7-de7e-45f2-acb3-8931d1397baf service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:47.236569 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9fcb7-de7e-45f2-acb3-8931d1397baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:47.247507 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9fcb7-de7e-45f2-acb3-8931d1397baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:47.249019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9fcb7-de7e-45f2-acb3-8931d1397baf service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:47.260681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1392/2816] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:35:47.644581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d5e61-9e11-4b1b-8ae7-0fe047da44b4 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:47.646052 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-223d5e61-9e11-4b1b-8ae7-0fe047da44b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:47.658425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d5e61-9e11-4b1b-8ae7-0fe047da44b4 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:47.663330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:47.663974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:47.664253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:47.664587 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] PATH_INFO: `/v3/projects/a88ac3131d1b47f38ad98abdf85a65aa` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:47.666339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a88ac3131d1b47f38ad98abdf85a65aa)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:47.668722 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:47.779636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a88ac3131d1b47f38ad98abdf85a65aa', 'request_id': 'req-61f9c22d-1462-4a13-a030-a8ef360549cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.785711 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a88ac3131d1b47f38ad98abdf85a65aa', 'request_id': 'req-61f9c22d-1462-4a13-a030-a8ef360549cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.791321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a88ac3131d1b47f38ad98abdf85a65aa', 'request_id': 'req-61f9c22d-1462-4a13-a030-a8ef360549cc'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.866847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:47.871424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] The token cache is being invalidate because project a88ac3131d1b47f38ad98abdf85a65aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:35:47.871718 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.872373 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-61f9c22d-1462-4a13-a030-a8ef360549cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:47.873933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1425/2817] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:35:47 2022] DELETE /identity/v3/projects/a88ac3131d1b47f38ad98abdf85a65aa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:47.878807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa7fef-d080-4423-8002-703e23a03715 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:47.879332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa7fef-d080-4423-8002-703e23a03715 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:47.879332 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa7fef-d080-4423-8002-703e23a03715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:47.899331 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-edfa7fef-d080-4423-8002-703e23a03715 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:47.900563 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-edfa7fef-d080-4423-8002-703e23a03715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:47.961120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1393/2818] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:47.970146 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2ef9e-80f2-413b-a4a2-c31967cd9d23 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:47.970432 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2ef9e-80f2-413b-a4a2-c31967cd9d23 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:47.970749 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2ef9e-80f2-413b-a4a2-c31967cd9d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:47.992388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-50f2ef9e-80f2-413b-a4a2-c31967cd9d23 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:47.993665 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-50f2ef9e-80f2-413b-a4a2-c31967cd9d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:48.002880 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1426/2819] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:48.009011 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa7fef-d080-4423-8002-703e23a03715 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:48.014003 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:48.019391 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa7fef-d080-4423-8002-703e23a03715 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:48.025112 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:48.025685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.025956 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.026264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.026871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:35:48.027194 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:48.028863 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:48.054153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1394/2820] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:35:48.077997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2ef9e-80f2-413b-a4a2-c31967cd9d23 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:48.088325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2ef9e-80f2-413b-a4a2-c31967cd9d23 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:48.093105 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69aa2f3-a5de-4dc8-83fe-4f57334c18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:48.093700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aa2f3-a5de-4dc8-83fe-4f57334c18a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.093981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aa2f3-a5de-4dc8-83fe-4f57334c18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.094255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69aa2f3-a5de-4dc8-83fe-4f57334c18a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.094894 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69aa2f3-a5de-4dc8-83fe-4f57334c18a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:48.096889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69aa2f3-a5de-4dc8-83fe-4f57334c18a7 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:48.227343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1427/2821] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:35:48 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:48.231848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:48.242408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cee62-4284-4e4d-ad95-c0ebf751e0dd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:48.298076 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8d0a-ae72-407d-8f6b-0143f92610f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:48.298670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8d0a-ae72-407d-8f6b-0143f92610f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.298947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8d0a-ae72-407d-8f6b-0143f92610f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.299213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa8d0a-ae72-407d-8f6b-0143f92610f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.299850 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa8d0a-ae72-407d-8f6b-0143f92610f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:48.302334 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caa8d0a-ae72-407d-8f6b-0143f92610f7 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:48.408041 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1395/2822] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:35:48 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:48.412341 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69aa2f3-a5de-4dc8-83fe-4f57334c18a7 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:48.422638 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69aa2f3-a5de-4dc8-83fe-4f57334c18a7 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:48.427771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b785ee-9a52-41b9-8d81-486929e47aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:48.428385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b785ee-9a52-41b9-8d81-486929e47aca admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.428666 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b785ee-9a52-41b9-8d81-486929e47aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.428936 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b785ee-9a52-41b9-8d81-486929e47aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.429580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b785ee-9a52-41b9-8d81-486929e47aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:48.431148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b785ee-9a52-41b9-8d81-486929e47aca admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:48.440941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1428/2823] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:35:48.445674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8d0a-ae72-407d-8f6b-0143f92610f7 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:48.455639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa8d0a-ae72-407d-8f6b-0143f92610f7 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:48.460562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36bf83-27ad-4191-97c0-5357c4d8e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:48.461148 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36bf83-27ad-4191-97c0-5357c4d8e47e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.461421 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36bf83-27ad-4191-97c0-5357c4d8e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.461689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36bf83-27ad-4191-97c0-5357c4d8e47e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.462323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36bf83-27ad-4191-97c0-5357c4d8e47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:48.463915 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36bf83-27ad-4191-97c0-5357c4d8e47e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:48.474510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1396/2824] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:35:48.478633 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b785ee-9a52-41b9-8d81-486929e47aca admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:48.488622 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b785ee-9a52-41b9-8d81-486929e47aca admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:48.493983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b679c22-21fe-4f27-b032-e892920fd80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:48.494623 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b679c22-21fe-4f27-b032-e892920fd80e admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.494902 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b679c22-21fe-4f27-b032-e892920fd80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.495176 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b679c22-21fe-4f27-b032-e892920fd80e admin admin] PATH_INFO: `/v3/projects/72677742abdb4e6d80ae84ceea86cbff/users/e8d4739511b24a0facf46a0855244ef2/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.510688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b679c22-21fe-4f27-b032-e892920fd80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72677742abdb4e6d80ae84ceea86cbff, user_id=e8d4739511b24a0facf46a0855244ef2, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:48.513376 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b679c22-21fe-4f27-b032-e892920fd80e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:48.607983 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1429/2825] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:35:48 2022] PUT /identity/v3/projects/72677742abdb4e6d80ae84ceea86cbff/users/e8d4739511b24a0facf46a0855244ef2/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:48.619099 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e04a7-586f-4cd0-b4fb-eb8470d9ed85 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.624019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e04a7-586f-4cd0-b4fb-eb8470d9ed85 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.624019 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e04a7-586f-4cd0-b4fb-eb8470d9ed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.648371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1f5e04a7-586f-4cd0-b4fb-eb8470d9ed85 None None] MFA Rules not processed for user `e8d4739511b24a0facf46a0855244ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:48.649592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1f5e04a7-586f-4cd0-b4fb-eb8470d9ed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:48.712623 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1397/2826] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:48.717084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b679c22-21fe-4f27-b032-e892920fd80e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:48.779116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b679c22-21fe-4f27-b032-e892920fd80e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:48.783830 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49cac-dee1-4d0f-95b4-ed65adb4999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:48.784458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49cac-dee1-4d0f-95b4-ed65adb4999b admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.784744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49cac-dee1-4d0f-95b4-ed65adb4999b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.785018 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49cac-dee1-4d0f-95b4-ed65adb4999b admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.786163 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f49cac-dee1-4d0f-95b4-ed65adb4999b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:48.788084 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f49cac-dee1-4d0f-95b4-ed65adb4999b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:48.876609 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1430/2827] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:35:48 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:48.880952 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e04a7-586f-4cd0-b4fb-eb8470d9ed85 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:48.891707 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e04a7-586f-4cd0-b4fb-eb8470d9ed85 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:48.942154 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:48.948068 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72c78f-3643-475f-8afc-64a1b6f860de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:48.948712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c78f-3643-475f-8afc-64a1b6f860de admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:48.948995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c78f-3643-475f-8afc-64a1b6f860de admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:48.953807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72c78f-3643-475f-8afc-64a1b6f860de admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:48.953807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72c78f-3643-475f-8afc-64a1b6f860de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:48.953807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72c78f-3643-475f-8afc-64a1b6f860de admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:49.041310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1398/2828] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:35:48 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:49.045300 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49cac-dee1-4d0f-95b4-ed65adb4999b admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:49.055563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49cac-dee1-4d0f-95b4-ed65adb4999b admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:49.060253 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d387db-3349-452a-ad89-677bc08569b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:49.060887 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d387db-3349-452a-ad89-677bc08569b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:49.061168 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d387db-3349-452a-ad89-677bc08569b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:49.061438 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d387db-3349-452a-ad89-677bc08569b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:49.062077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d387db-3349-452a-ad89-677bc08569b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:49.063822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d387db-3349-452a-ad89-677bc08569b2 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:49.074543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1431/2829] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:35:49.078613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72c78f-3643-475f-8afc-64a1b6f860de admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:49.089498 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72c78f-3643-475f-8afc-64a1b6f860de admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:49.094282 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ebfd-d4dd-4b41-a190-f7cecbeac05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:49.094917 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ebfd-d4dd-4b41-a190-f7cecbeac05b admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:49.095192 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ebfd-d4dd-4b41-a190-f7cecbeac05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:49.095463 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ebfd-d4dd-4b41-a190-f7cecbeac05b admin admin] PATH_INFO: `/v3/projects/aa6f91b23fb74dd0ab6801c9d078ce37/users/45058711d0cb46c9b1cdb0277653abaf/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:49.111106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ebfd-d4dd-4b41-a190-f7cecbeac05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6f91b23fb74dd0ab6801c9d078ce37, user_id=45058711d0cb46c9b1cdb0277653abaf, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:49.114418 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ebfd-d4dd-4b41-a190-f7cecbeac05b admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:49.219556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1399/2830] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:35:49 2022] PUT /identity/v3/projects/aa6f91b23fb74dd0ab6801c9d078ce37/users/45058711d0cb46c9b1cdb0277653abaf/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:49.224126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d387db-3349-452a-ad89-677bc08569b2 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:49.234075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d387db-3349-452a-ad89-677bc08569b2 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:49.291054 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670896-b3d3-4bc5-916c-c3ebd0cfdafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:49.291656 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670896-b3d3-4bc5-916c-c3ebd0cfdafe admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:49.291939 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670896-b3d3-4bc5-916c-c3ebd0cfdafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:49.292213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670896-b3d3-4bc5-916c-c3ebd0cfdafe admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:49.292886 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670896-b3d3-4bc5-916c-c3ebd0cfdafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:49.294488 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670896-b3d3-4bc5-916c-c3ebd0cfdafe admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:49.304539 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1432/2831] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:35:49.308726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ebfd-d4dd-4b41-a190-f7cecbeac05b admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:49.319206 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ebfd-d4dd-4b41-a190-f7cecbeac05b admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:49.324117 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:49.324805 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:49.325084 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:49.325356 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] PATH_INFO: `/v3/projects/aa6f91b23fb74dd0ab6801c9d078ce37/users/45058711d0cb46c9b1cdb0277653abaf/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:49.327296 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6f91b23fb74dd0ab6801c9d078ce37, user_id=45058711d0cb46c9b1cdb0277653abaf, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:49.330042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:49.341086 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1400/2832] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:35:49 2022] PUT /identity/v3/projects/aa6f91b23fb74dd0ab6801c9d078ce37/users/45058711d0cb46c9b1cdb0277653abaf/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:35:49.351926 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff1a0-5e50-4b0e-ad31-280d85da9ea2 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:49.352216 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff1a0-5e50-4b0e-ad31-280d85da9ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:49.352530 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff1a0-5e50-4b0e-ad31-280d85da9ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:49.360700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:49.380777 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-450ff1a0-5e50-4b0e-ad31-280d85da9ea2 None None] MFA Rules not processed for user `45058711d0cb46c9b1cdb0277653abaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:49.382005 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-450ff1a0-5e50-4b0e-ad31-280d85da9ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:49.450932 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1433/2833] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:49.463800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:49.465547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:49.523381 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc9cf0-f535-40a8-abc3-0722cf079187 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:49.526960 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c3247-bfd2-4c72-9aef-b785be08da08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:49.527551 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c3247-bfd2-4c72-9aef-b785be08da08 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:49.527828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c3247-bfd2-4c72-9aef-b785be08da08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:49.528097 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c3247-bfd2-4c72-9aef-b785be08da08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:49.537153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c3247-bfd2-4c72-9aef-b785be08da08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:49.538580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c3247-bfd2-4c72-9aef-b785be08da08 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:49.547679 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1401/2834] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:35:50.413845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ff1a0-5e50-4b0e-ad31-280d85da9ea2 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:50.423092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ff1a0-5e50-4b0e-ad31-280d85da9ea2 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:50.428761 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45058711d0cb46c9b1cdb0277653abaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa6f91b23fb74dd0ab6801c9d078ce37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:50.433933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:50.433933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:50.433933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:50.433933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:35:50.433933 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:50.434428 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:50.445455 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1434/2835] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:35:50.449361 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c3247-bfd2-4c72-9aef-b785be08da08 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:50.458534 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c3247-bfd2-4c72-9aef-b785be08da08 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:50.463149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015af0-a0e2-4c19-9486-3d1cdb24ca96 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45058711d0cb46c9b1cdb0277653abaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa6f91b23fb74dd0ab6801c9d078ce37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:50.463751 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015af0-a0e2-4c19-9486-3d1cdb24ca96 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:50.464034 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015af0-a0e2-4c19-9486-3d1cdb24ca96 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:50.464344 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19015af0-a0e2-4c19-9486-3d1cdb24ca96 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:50.464998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19015af0-a0e2-4c19-9486-3d1cdb24ca96 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:50.466897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19015af0-a0e2-4c19-9486-3d1cdb24ca96 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:50.556327 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1402/2836] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:35:50 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:35:50.560484 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:50.570598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e5d4-0674-4064-b7a6-7211e2b6fb1d tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:50.626514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45058711d0cb46c9b1cdb0277653abaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa6f91b23fb74dd0ab6801c9d078ce37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:50.627050 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:50.627337 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:50.627620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:50.628264 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:35:50.628604 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:50.630476 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:50.642236 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1435/2837] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:35:50.681219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015af0-a0e2-4c19-9486-3d1cdb24ca96 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:50.691732 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19015af0-a0e2-4c19-9486-3d1cdb24ca96 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:50.696520 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45058711d0cb46c9b1cdb0277653abaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa6f91b23fb74dd0ab6801c9d078ce37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:50.697147 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:50.697433 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:50.697709 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] PATH_INFO: `/v3/projects/033caffe11614dc9b12f48063623f4e7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:50.698853 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Authorizing `identity:delete_project(project_id=033caffe11614dc9b12f48063623f4e7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:50.700820 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:50.802390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033caffe11614dc9b12f48063623f4e7', 'request_id': 'req-9a456f93-1e57-47db-9de5-d856dc3f9aeb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:50.881833 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033caffe11614dc9b12f48063623f4e7', 'request_id': 'req-9a456f93-1e57-47db-9de5-d856dc3f9aeb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:50.889108 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033caffe11614dc9b12f48063623f4e7', 'request_id': 'req-9a456f93-1e57-47db-9de5-d856dc3f9aeb'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:50.900431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] The token cache is being invalidate because project 033caffe11614dc9b12f48063623f4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:35:50.900721 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:50.901374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-9a456f93-1e57-47db-9de5-d856dc3f9aeb tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:50.902891 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1403/2838] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:35:50 2022] DELETE /identity/v3/projects/033caffe11614dc9b12f48063623f4e7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:51.497294 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:51.499505 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:51.565709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b210e-73f0-4ab9-8514-abcb69fdcdf5 tempest-VolumeQuotaClassesTest-625819009 tempest-VolumeQuotaClassesTest-625819009-project-admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:51.578311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=100 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:51.621456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:51.622079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:51.622355 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:51.622624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] PATH_INFO: `/v3/users/e8d4739511b24a0facf46a0855244ef2` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:51.623739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d4739511b24a0facf46a0855244ef2)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:51.625678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:51.816116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d4739511b24a0facf46a0855244ef2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:51.823395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d4739511b24a0facf46a0855244ef2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:51.839858 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d4739511b24a0facf46a0855244ef2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:51.911612 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d4739511b24a0facf46a0855244ef2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:51.912246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d4739511b24a0facf46a0855244ef2'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:51.918390 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1436/2839] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:35:51 2022] DELETE /identity/v3/users/e8d4739511b24a0facf46a0855244ef2 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:51.922888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699067-c939-4b56-ae75-7c1ce5b56d24 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:51.923390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699067-c939-4b56-ae75-7c1ce5b56d24 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:51.923500 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc699067-c939-4b56-ae75-7c1ce5b56d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:51.942613 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-fc699067-c939-4b56-ae75-7c1ce5b56d24 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:51.943792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fc699067-c939-4b56-ae75-7c1ce5b56d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:51.951770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:52.002515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1404/2840] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:52.012752 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:52.014140 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:52.074588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40d30b-c8b8-4298-8def-bd889da2f348 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:52.078237 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8470d6-b227-4f4f-828e-6e87bfa3a68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:52.078849 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8470d6-b227-4f4f-828e-6e87bfa3a68e service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:52.079133 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8470d6-b227-4f4f-828e-6e87bfa3a68e service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:52.079398 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8470d6-b227-4f4f-828e-6e87bfa3a68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:52.088848 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8470d6-b227-4f4f-828e-6e87bfa3a68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:52.094465 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8470d6-b227-4f4f-828e-6e87bfa3a68e service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:52.105812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1437/2841] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:35:52.516530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699067-c939-4b56-ae75-7c1ce5b56d24 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:52.518004 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-fc699067-c939-4b56-ae75-7c1ce5b56d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:52.533436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc699067-c939-4b56-ae75-7c1ce5b56d24 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:52.540706 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:52.541352 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:52.546770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:52.547109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] PATH_INFO: `/v3/projects/72677742abdb4e6d80ae84ceea86cbff` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:52.548509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72677742abdb4e6d80ae84ceea86cbff)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:52.550455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:52.659770 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72677742abdb4e6d80ae84ceea86cbff', 'request_id': 'req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:52.739949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72677742abdb4e6d80ae84ceea86cbff', 'request_id': 'req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:52.746685 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72677742abdb4e6d80ae84ceea86cbff', 'request_id': 'req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:52.757953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] The token cache is being invalidate because project 72677742abdb4e6d80ae84ceea86cbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:35:52.758241 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:52.758871 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:52.760389 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1405/2842] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:35:52 2022] DELETE /identity/v3/projects/72677742abdb4e6d80ae84ceea86cbff => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:35:52.764418 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8470d6-b227-4f4f-828e-6e87bfa3a68e service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:52.774416 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8470d6-b227-4f4f-828e-6e87bfa3a68e service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:52.812099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:52.831074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:52.831706 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:52.832011 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:52.832323 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] PATH_INFO: `/v3/users/45058711d0cb46c9b1cdb0277653abaf` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:52.833532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45058711d0cb46c9b1cdb0277653abaf)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:52.836449 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:52.981382 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45058711d0cb46c9b1cdb0277653abaf'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:52.988122 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45058711d0cb46c9b1cdb0277653abaf'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.000194 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45058711d0cb46c9b1cdb0277653abaf'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.076563 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45058711d0cb46c9b1cdb0277653abaf'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.077224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-29308a8f-4e00-43d0-a9d5-5058eaaaa138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45058711d0cb46c9b1cdb0277653abaf'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.083582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1438/2843] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:35:52 2022] DELETE /identity/v3/users/45058711d0cb46c9b1cdb0277653abaf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:53.506918 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:53.508550 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:53.522530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f7a3-f582-46b3-afe8-3a1b9c5fe730 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:53.577700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:53.578323 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:53.578600 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:53.578870 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] PATH_INFO: `/v3/projects/aa6f91b23fb74dd0ab6801c9d078ce37` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:53.579966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6f91b23fb74dd0ab6801c9d078ce37)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:53.581910 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:53.675831 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:53.682689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6f91b23fb74dd0ab6801c9d078ce37', 'request_id': 'req-2000f6d5-a45f-473a-80b3-5a13f7090e16'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.733795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6f91b23fb74dd0ab6801c9d078ce37', 'request_id': 'req-2000f6d5-a45f-473a-80b3-5a13f7090e16'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.740156 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6f91b23fb74dd0ab6801c9d078ce37', 'request_id': 'req-2000f6d5-a45f-473a-80b3-5a13f7090e16'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.757607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] The token cache is being invalidate because project aa6f91b23fb74dd0ab6801c9d078ce37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:35:53.757607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.757607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2000f6d5-a45f-473a-80b3-5a13f7090e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:35:53.757607 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1406/2844] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:35:53 2022] DELETE /identity/v3/projects/aa6f91b23fb74dd0ab6801c9d078ce37 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:53.760286 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2099-850b-4cdc-b6f3-782fc537916e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:53.760599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2099-850b-4cdc-b6f3-782fc537916e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:53.760882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab2099-850b-4cdc-b6f3-782fc537916e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:53.780750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-ceab2099-850b-4cdc-b6f3-782fc537916e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:53.781946 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-ceab2099-850b-4cdc-b6f3-782fc537916e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:53.842699 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1439/2845] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:53.851271 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625884a-0e76-4f9e-a25e-702315211dc3 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:53.851547 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625884a-0e76-4f9e-a25e-702315211dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:53.851842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625884a-0e76-4f9e-a25e-702315211dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:53.871116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-1625884a-0e76-4f9e-a25e-702315211dc3 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:53.872311 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-1625884a-0e76-4f9e-a25e-702315211dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:53.881222 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1407/2846] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:53.885339 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2099-850b-4cdc-b6f3-782fc537916e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:53.895636 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab2099-850b-4cdc-b6f3-782fc537916e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:53.900180 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:53.900820 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:53.901117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:53.901401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:53.902043 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:35:53.902343 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:53.903973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:53.915306 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1440/2847] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:35:53.919427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625884a-0e76-4f9e-a25e-702315211dc3 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:53.928680 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625884a-0e76-4f9e-a25e-702315211dc3 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:53.934116 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64506-52a7-4d9c-8b62-e38ee19cf80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:53.934700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64506-52a7-4d9c-8b62-e38ee19cf80e admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:53.934977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64506-52a7-4d9c-8b62-e38ee19cf80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:53.935247 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64506-52a7-4d9c-8b62-e38ee19cf80e admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:53.935874 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64506-52a7-4d9c-8b62-e38ee19cf80e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:53.937799 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d64506-52a7-4d9c-8b62-e38ee19cf80e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:54.025204 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1408/2848] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:35:53 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:54.029330 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:54.039445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55667-155f-4c0f-ac41-159c17ea22f5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:54.083884 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:54.096220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d224031-e66a-4dc8-9c4d-f901e03f7250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:54.096845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224031-e66a-4dc8-9c4d-f901e03f7250 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.097126 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224031-e66a-4dc8-9c4d-f901e03f7250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.097401 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d224031-e66a-4dc8-9c4d-f901e03f7250 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.098057 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d224031-e66a-4dc8-9c4d-f901e03f7250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:54.100077 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d224031-e66a-4dc8-9c4d-f901e03f7250 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:54.215447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1441/2849] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:35:54 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:54.219751 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64506-52a7-4d9c-8b62-e38ee19cf80e admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:54.230326 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64506-52a7-4d9c-8b62-e38ee19cf80e admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:54.235484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39ea9-eafe-4601-8914-f27972277033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:54.236082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ea9-eafe-4601-8914-f27972277033 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.236395 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ea9-eafe-4601-8914-f27972277033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.236667 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ea9-eafe-4601-8914-f27972277033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.237310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f39ea9-eafe-4601-8914-f27972277033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:54.238945 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f39ea9-eafe-4601-8914-f27972277033 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:54.249458 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1409/2850] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:35:54.253404 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d224031-e66a-4dc8-9c4d-f901e03f7250 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:54.264740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d224031-e66a-4dc8-9c4d-f901e03f7250 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:54.269332 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4203-6ea8-4d54-a188-a1b9ca558fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:54.269919 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4203-6ea8-4d54-a188-a1b9ca558fce admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.270195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4203-6ea8-4d54-a188-a1b9ca558fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.270991 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4203-6ea8-4d54-a188-a1b9ca558fce admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.272117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4203-6ea8-4d54-a188-a1b9ca558fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:54.273847 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4203-6ea8-4d54-a188-a1b9ca558fce admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:54.284220 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1442/2851] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:35:54.288663 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39ea9-eafe-4601-8914-f27972277033 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:54.298489 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39ea9-eafe-4601-8914-f27972277033 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:54.303184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c072cd-434c-4849-809a-2f834e4f3fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:54.303824 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c072cd-434c-4849-809a-2f834e4f3fda admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.304104 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c072cd-434c-4849-809a-2f834e4f3fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.304408 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c072cd-434c-4849-809a-2f834e4f3fda admin admin] PATH_INFO: `/v3/projects/813f99d21a714506af13d2ef2a23be49/users/789a8a8867de404e88205de20aa1ac18/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.318587 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c072cd-434c-4849-809a-2f834e4f3fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=813f99d21a714506af13d2ef2a23be49, user_id=789a8a8867de404e88205de20aa1ac18, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:54.321285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c072cd-434c-4849-809a-2f834e4f3fda admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:54.397343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1410/2852] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:35:54 2022] PUT /identity/v3/projects/813f99d21a714506af13d2ef2a23be49/users/789a8a8867de404e88205de20aa1ac18/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:54.407770 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e05c1-3778-4d63-bbff-d14dfaee862a None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.408056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e05c1-3778-4d63-bbff-d14dfaee862a None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.408350 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e05c1-3778-4d63-bbff-d14dfaee862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.436990 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-631e05c1-3778-4d63-bbff-d14dfaee862a None None] MFA Rules not processed for user `789a8a8867de404e88205de20aa1ac18`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:54.438441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-631e05c1-3778-4d63-bbff-d14dfaee862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:54.502318 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1443/2853] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:35:54.507214 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c072cd-434c-4849-809a-2f834e4f3fda admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:54.568942 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c072cd-434c-4849-809a-2f834e4f3fda admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:54.573584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab9a3b-ef90-41c9-af12-fb3b49323466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:54.574179 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab9a3b-ef90-41c9-af12-fb3b49323466 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.574455 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab9a3b-ef90-41c9-af12-fb3b49323466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.574726 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab9a3b-ef90-41c9-af12-fb3b49323466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.575371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab9a3b-ef90-41c9-af12-fb3b49323466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:54.577371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab9a3b-ef90-41c9-af12-fb3b49323466 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:54.650032 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1411/2854] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:35:54 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:54.653877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e05c1-3778-4d63-bbff-d14dfaee862a None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:54.664771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e05c1-3778-4d63-bbff-d14dfaee862a None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:54.720037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5f0b4-8662-4dce-81c1-e80bc0502846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:54.720660 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f0b4-8662-4dce-81c1-e80bc0502846 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.720941 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f0b4-8662-4dce-81c1-e80bc0502846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.721210 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5f0b4-8662-4dce-81c1-e80bc0502846 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.721831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5f0b4-8662-4dce-81c1-e80bc0502846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:54.723922 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5f0b4-8662-4dce-81c1-e80bc0502846 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:54.831678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1444/2855] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:35:54 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:35:54.835852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab9a3b-ef90-41c9-af12-fb3b49323466 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:54.846588 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab9a3b-ef90-41c9-af12-fb3b49323466 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:54.851340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22715d7c-450c-42fa-86ef-4197e5f2407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:54.851940 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22715d7c-450c-42fa-86ef-4197e5f2407d admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.852219 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22715d7c-450c-42fa-86ef-4197e5f2407d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.852529 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22715d7c-450c-42fa-86ef-4197e5f2407d admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.853213 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22715d7c-450c-42fa-86ef-4197e5f2407d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:54.854807 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22715d7c-450c-42fa-86ef-4197e5f2407d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:54.865451 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1412/2856] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:35:54.869780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5f0b4-8662-4dce-81c1-e80bc0502846 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:54.879667 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5f0b4-8662-4dce-81c1-e80bc0502846 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:54.885056 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7277-650d-4ca7-b107-d8112ce397f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:54.885726 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7277-650d-4ca7-b107-d8112ce397f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:54.890082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7277-650d-4ca7-b107-d8112ce397f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:54.890082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7277-650d-4ca7-b107-d8112ce397f1 admin admin] PATH_INFO: `/v3/projects/e8221fa8a864436d83954c02d0e142d0/users/1899fbadece340a2bb1767b9aa4ff7b1/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:54.901468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c7277-650d-4ca7-b107-d8112ce397f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8221fa8a864436d83954c02d0e142d0, user_id=1899fbadece340a2bb1767b9aa4ff7b1, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:54.904144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c7277-650d-4ca7-b107-d8112ce397f1 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:55.003062 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1445/2857] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:35:54 2022] PUT /identity/v3/projects/e8221fa8a864436d83954c02d0e142d0/users/1899fbadece340a2bb1767b9aa4ff7b1/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:55.007746 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22715d7c-450c-42fa-86ef-4197e5f2407d admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:55.017608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22715d7c-450c-42fa-86ef-4197e5f2407d admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:55.051036 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:55.074491 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc586fc4-bcc8-4f9d-95f3-b74d6000cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:55.075090 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586fc4-bcc8-4f9d-95f3-b74d6000cd90 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:55.075376 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586fc4-bcc8-4f9d-95f3-b74d6000cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:55.075645 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586fc4-bcc8-4f9d-95f3-b74d6000cd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:55.076279 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc586fc4-bcc8-4f9d-95f3-b74d6000cd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:55.077897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc586fc4-bcc8-4f9d-95f3-b74d6000cd90 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:55.087812 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1413/2858] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:35:55.091895 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7277-650d-4ca7-b107-d8112ce397f1 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:55.102298 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7277-650d-4ca7-b107-d8112ce397f1 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:55.106921 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:55.107554 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:55.108082 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:55.108395 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] PATH_INFO: `/v3/projects/e8221fa8a864436d83954c02d0e142d0/users/1899fbadece340a2bb1767b9aa4ff7b1/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:55.110344 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8221fa8a864436d83954c02d0e142d0, user_id=1899fbadece340a2bb1767b9aa4ff7b1, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:55.113037 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:55.124442 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1446/2859] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:35:55 2022] PUT /identity/v3/projects/e8221fa8a864436d83954c02d0e142d0/users/1899fbadece340a2bb1767b9aa4ff7b1/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:35:55.136646 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4558-e0fb-4da7-a5f0-bf8dfa98222a None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:55.137184 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4558-e0fb-4da7-a5f0-bf8dfa98222a None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:55.137629 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf4558-e0fb-4da7-a5f0-bf8dfa98222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:55.165670 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-41bf4558-e0fb-4da7-a5f0-bf8dfa98222a None None] MFA Rules not processed for user `1899fbadece340a2bb1767b9aa4ff7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:35:55.167590 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-41bf4558-e0fb-4da7-a5f0-bf8dfa98222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:55.233293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1414/2860] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:35:55.297359 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:55.299076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:55.309781 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:35:55.359758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55329b02-b186-4b64-a541-cb2586aa44e0 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:55.363460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08556e-cfa8-47b6-a2ce-8c17103adfab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:55.364102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08556e-cfa8-47b6-a2ce-8c17103adfab service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:55.364980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08556e-cfa8-47b6-a2ce-8c17103adfab service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:55.365258 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08556e-cfa8-47b6-a2ce-8c17103adfab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:55.374522 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08556e-cfa8-47b6-a2ce-8c17103adfab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:55.375980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08556e-cfa8-47b6-a2ce-8c17103adfab service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:55.385759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1447/2861] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:35:55.431854 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf4558-e0fb-4da7-a5f0-bf8dfa98222a None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:35:55.433267 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-41bf4558-e0fb-4da7-a5f0-bf8dfa98222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:35:55.445166 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf4558-e0fb-4da7-a5f0-bf8dfa98222a None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:35:55.449061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aedf0d-718a-4a77-9b5c-8583050e7d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:35:55.449655 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aedf0d-718a-4a77-9b5c-8583050e7d4d service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:35:55.449937 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aedf0d-718a-4a77-9b5c-8583050e7d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:35:55.450215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aedf0d-718a-4a77-9b5c-8583050e7d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:35:55.508096 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aedf0d-718a-4a77-9b5c-8583050e7d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:35:55.509580 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aedf0d-718a-4a77-9b5c-8583050e7d4d service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:35:55.518375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1415/2862] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:35:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:00.149860 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08556e-cfa8-47b6-a2ce-8c17103adfab service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:00.211867 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08556e-cfa8-47b6-a2ce-8c17103adfab service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:00.216423 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:00.217042 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:00.217340 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:00.217594 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] PATH_INFO: `/v3/users/789a8a8867de404e88205de20aa1ac18` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:00.218730 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=789a8a8867de404e88205de20aa1ac18)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:00.220661 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:00.425552 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789a8a8867de404e88205de20aa1ac18'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:00.433024 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789a8a8867de404e88205de20aa1ac18'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:00.445620 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789a8a8867de404e88205de20aa1ac18'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:00.508796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789a8a8867de404e88205de20aa1ac18'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:00.509482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789a8a8867de404e88205de20aa1ac18'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:00.516120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1448/2863] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:36:00 2022] DELETE /identity/v3/users/789a8a8867de404e88205de20aa1ac18 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:00.521007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125798f-e7b4-4ff9-b5e6-175492a40e71 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:00.521522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125798f-e7b4-4ff9-b5e6-175492a40e71 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:00.521641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125798f-e7b4-4ff9-b5e6-175492a40e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:00.540450 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-2125798f-e7b4-4ff9-b5e6-175492a40e71 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:00.541635 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2125798f-e7b4-4ff9-b5e6-175492a40e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:00.590477 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=100 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:00.600130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1416/2864] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:36:00.610161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:00.611580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:00.644081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:00.669278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75a0f-c913-44fa-9edf-5996863c73ca admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:00.672967 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3529-00a8-41f6-bfd3-118fb0923c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:00.674106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3529-00a8-41f6-bfd3-118fb0923c3f service neutron] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:00.674106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3529-00a8-41f6-bfd3-118fb0923c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:00.674106 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba3529-00a8-41f6-bfd3-118fb0923c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:00.684120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba3529-00a8-41f6-bfd3-118fb0923c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:00.685523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba3529-00a8-41f6-bfd3-118fb0923c3f service neutron] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:00.694954 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1449/2865] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:01.156130 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125798f-e7b4-4ff9-b5e6-175492a40e71 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:01.157575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2125798f-e7b4-4ff9-b5e6-175492a40e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:01.171702 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125798f-e7b4-4ff9-b5e6-175492a40e71 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:01.176800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:01.177735 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:01.178631 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:01.179033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] PATH_INFO: `/v3/projects/813f99d21a714506af13d2ef2a23be49` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:01.180454 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] RBAC: Authorizing `identity:delete_project(project_id=813f99d21a714506af13d2ef2a23be49)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:01.182598 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:01.298106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813f99d21a714506af13d2ef2a23be49', 'request_id': 'req-2186871d-5ac7-4f39-817f-db01b69caafe'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.379278 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813f99d21a714506af13d2ef2a23be49', 'request_id': 'req-2186871d-5ac7-4f39-817f-db01b69caafe'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.386756 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813f99d21a714506af13d2ef2a23be49', 'request_id': 'req-2186871d-5ac7-4f39-817f-db01b69caafe'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.397885 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] The token cache is being invalidate because project 813f99d21a714506af13d2ef2a23be49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:36:01.398180 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.398828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.400505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1417/2866] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:36:01 2022] DELETE /identity/v3/projects/813f99d21a714506af13d2ef2a23be49 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:01.404624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3529-00a8-41f6-bfd3-118fb0923c3f service neutron] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:01.414642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba3529-00a8-41f6-bfd3-118fb0923c3f service neutron] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:01.471285 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:01.471907 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:01.472181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:01.472483 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] PATH_INFO: `/v3/users/1899fbadece340a2bb1767b9aa4ff7b1` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:01.473586 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1899fbadece340a2bb1767b9aa4ff7b1)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:01.475518 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:01.700578 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1899fbadece340a2bb1767b9aa4ff7b1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.707391 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1899fbadece340a2bb1767b9aa4ff7b1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.720031 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1899fbadece340a2bb1767b9aa4ff7b1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.783061 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1899fbadece340a2bb1767b9aa4ff7b1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.783677 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-e4fb3ba6-5be1-43e3-97cb-33374cc7f47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1899fbadece340a2bb1767b9aa4ff7b1'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:01.789959 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1450/2867] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:36:01 2022] DELETE /identity/v3/users/1899fbadece340a2bb1767b9aa4ff7b1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:02.164417 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:02.167310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:02.179621 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186871d-5ac7-4f39-817f-db01b69caafe admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:02.235149 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:02.235771 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.236049 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.236347 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] PATH_INFO: `/v3/projects/e8221fa8a864436d83954c02d0e142d0` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.237515 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8221fa8a864436d83954c02d0e142d0)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:02.240419 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:02.333826 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8221fa8a864436d83954c02d0e142d0', 'request_id': 'req-302803bf-704f-43cf-aa19-5e7d9aa80d0d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:02.384949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8221fa8a864436d83954c02d0e142d0', 'request_id': 'req-302803bf-704f-43cf-aa19-5e7d9aa80d0d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:02.391342 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8221fa8a864436d83954c02d0e142d0', 'request_id': 'req-302803bf-704f-43cf-aa19-5e7d9aa80d0d'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:02.401481 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] The token cache is being invalidate because project e8221fa8a864436d83954c02d0e142d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:36:02.402152 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:02.402620 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-302803bf-704f-43cf-aa19-5e7d9aa80d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:02.404102 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1418/2868] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:36:02 2022] DELETE /identity/v3/projects/e8221fa8a864436d83954c02d0e142d0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:02.409026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845d226-9838-43a4-8ba0-58c890f47a3d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.409496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845d226-9838-43a4-8ba0-58c890f47a3d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.409611 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845d226-9838-43a4-8ba0-58c890f47a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.429981 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f845d226-9838-43a4-8ba0-58c890f47a3d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:02.431177 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f845d226-9838-43a4-8ba0-58c890f47a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:02.475480 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:02.489424 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1451/2869] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:02.497121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1634-5b4a-4264-85f4-8bc2dc60453c None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.497415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1634-5b4a-4264-85f4-8bc2dc60453c None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.497698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e1634-5b4a-4264-85f4-8bc2dc60453c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.517488 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-e75e1634-5b4a-4264-85f4-8bc2dc60453c None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:02.518700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-e75e1634-5b4a-4264-85f4-8bc2dc60453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:02.527292 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1419/2870] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:02.531615 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845d226-9838-43a4-8ba0-58c890f47a3d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:02.541882 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845d226-9838-43a4-8ba0-58c890f47a3d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:02.547268 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:02.547877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.548159 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.548466 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] PATH_INFO: `/v3/domains` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.549120 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81596) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:36:02.549421 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:02.551026 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:02.562796 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1452/2871] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:36:02.567161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e1634-5b4a-4264-85f4-8bc2dc60453c None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:02.573077 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:02.576658 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e1634-5b4a-4264-85f4-8bc2dc60453c None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:02.581393 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342d0e0-f6f0-4723-a95f-fda4d8672183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:02.581993 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342d0e0-f6f0-4723-a95f-fda4d8672183 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.582268 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342d0e0-f6f0-4723-a95f-fda4d8672183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.585020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342d0e0-f6f0-4723-a95f-fda4d8672183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.585020 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342d0e0-f6f0-4723-a95f-fda4d8672183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:02.585608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342d0e0-f6f0-4723-a95f-fda4d8672183 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:02.649933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1420/2872] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:36:02 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:36:02.654036 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:02.664580 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b455a-69ef-4a55-90c4-1faee0ae957c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:02.720543 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dd93c-361d-4fdb-9620-a8268238da71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:02.721150 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dd93c-361d-4fdb-9620-a8268238da71 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.721441 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dd93c-361d-4fdb-9620-a8268238da71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.721719 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dd93c-361d-4fdb-9620-a8268238da71 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.722364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dd93c-361d-4fdb-9620-a8268238da71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:02.725266 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dd93c-361d-4fdb-9620-a8268238da71 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:02.817825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1453/2873] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:36:02 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:36:02.822000 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342d0e0-f6f0-4723-a95f-fda4d8672183 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:02.832239 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342d0e0-f6f0-4723-a95f-fda4d8672183 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:02.838045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c215d76-4e22-4fe4-93bd-3d126424ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:02.838675 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215d76-4e22-4fe4-93bd-3d126424ea8f admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.838959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215d76-4e22-4fe4-93bd-3d126424ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.839269 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215d76-4e22-4fe4-93bd-3d126424ea8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.839933 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c215d76-4e22-4fe4-93bd-3d126424ea8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:02.841721 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c215d76-4e22-4fe4-93bd-3d126424ea8f admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:02.852508 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1421/2874] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:36:02.856422 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dd93c-361d-4fdb-9620-a8268238da71 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:02.866385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dd93c-361d-4fdb-9620-a8268238da71 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:02.871012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e723869-53c9-4bcf-8529-d28525879d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:02.871599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723869-53c9-4bcf-8529-d28525879d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.871883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723869-53c9-4bcf-8529-d28525879d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.872161 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e723869-53c9-4bcf-8529-d28525879d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.872844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e723869-53c9-4bcf-8529-d28525879d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:02.874445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e723869-53c9-4bcf-8529-d28525879d7c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:02.885823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1454/2875] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:36:02.889622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c215d76-4e22-4fe4-93bd-3d126424ea8f admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:02.899998 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c215d76-4e22-4fe4-93bd-3d126424ea8f admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:02.904537 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3aad8-838a-4462-805c-2700e939f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:02.905172 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3aad8-838a-4462-805c-2700e939f25c admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.905447 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3aad8-838a-4462-805c-2700e939f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.905718 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3aad8-838a-4462-805c-2700e939f25c admin admin] PATH_INFO: `/v3/projects/196a333f45e04cba843d069dfc8aea8f/users/923ffd6f06354d4485171b28965b6cc7/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:02.919731 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3aad8-838a-4462-805c-2700e939f25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=196a333f45e04cba843d069dfc8aea8f, user_id=923ffd6f06354d4485171b28965b6cc7, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:02.922410 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3aad8-838a-4462-805c-2700e939f25c admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:02.985089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1422/2876] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:36:02 2022] PUT /identity/v3/projects/196a333f45e04cba843d069dfc8aea8f/users/923ffd6f06354d4485171b28965b6cc7/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:02.994845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76a89-fdc2-4091-9f42-c36008d43dd0 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:02.995214 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76a89-fdc2-4091-9f42-c36008d43dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:02.995527 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d76a89-fdc2-4091-9f42-c36008d43dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:03.024316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-b8d76a89-fdc2-4091-9f42-c36008d43dd0 None None] MFA Rules not processed for user `923ffd6f06354d4485171b28965b6cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:03.025576 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-b8d76a89-fdc2-4091-9f42-c36008d43dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:03.088758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1455/2877] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:03.093369 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3aad8-838a-4462-805c-2700e939f25c admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:03.154649 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3aad8-838a-4462-805c-2700e939f25c admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:03.159264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aa3a3-d9e4-4db1-b70d-42e8787a1458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:03.159856 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aa3a3-d9e4-4db1-b70d-42e8787a1458 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:03.160134 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aa3a3-d9e4-4db1-b70d-42e8787a1458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:03.160438 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aa3a3-d9e4-4db1-b70d-42e8787a1458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:03.161250 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21aa3a3-d9e4-4db1-b70d-42e8787a1458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:03.163248 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21aa3a3-d9e4-4db1-b70d-42e8787a1458 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:03.237828 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1423/2878] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:36:03 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:36:03.242509 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76a89-fdc2-4091-9f42-c36008d43dd0 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:03.253246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d76a89-fdc2-4091-9f42-c36008d43dd0 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:03.298721 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:03.311553 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6350-473c-479a-a1e6-10d22371107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:03.312158 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6350-473c-479a-a1e6-10d22371107e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:03.312498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6350-473c-479a-a1e6-10d22371107e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:03.312798 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6350-473c-479a-a1e6-10d22371107e admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:03.316004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca6350-473c-479a-a1e6-10d22371107e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:03.316004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca6350-473c-479a-a1e6-10d22371107e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:03.430000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1456/2879] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:36:03 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:36:03.433860 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aa3a3-d9e4-4db1-b70d-42e8787a1458 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:03.444976 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aa3a3-d9e4-4db1-b70d-42e8787a1458 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:03.449539 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f6da2-9389-4816-b7c0-8584c7568df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:03.450136 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f6da2-9389-4816-b7c0-8584c7568df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:03.450415 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f6da2-9389-4816-b7c0-8584c7568df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:03.450684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f6da2-9389-4816-b7c0-8584c7568df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:03.451324 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f6da2-9389-4816-b7c0-8584c7568df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:03.452966 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f6da2-9389-4816-b7c0-8584c7568df8 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:03.463574 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1424/2880] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:36:03.467574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6350-473c-479a-a1e6-10d22371107e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:03.477568 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6350-473c-479a-a1e6-10d22371107e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:03.482208 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a441-2cba-4602-bebe-4d092e5f7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:03.482802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a441-2cba-4602-bebe-4d092e5f7c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:03.483083 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a441-2cba-4602-bebe-4d092e5f7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:03.483357 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a441-2cba-4602-bebe-4d092e5f7c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:03.484004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a441-2cba-4602-bebe-4d092e5f7c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:03.485625 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a441-2cba-4602-bebe-4d092e5f7c95 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:03.496384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1457/2881] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:36:03.500255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f6da2-9389-4816-b7c0-8584c7568df8 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:03.510774 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f6da2-9389-4816-b7c0-8584c7568df8 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:03.515310 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32dbcb-d49d-476f-b433-09ef255e9ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:03.515949 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32dbcb-d49d-476f-b433-09ef255e9ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:03.516225 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32dbcb-d49d-476f-b433-09ef255e9ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:03.516530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32dbcb-d49d-476f-b433-09ef255e9ef1 admin admin] PATH_INFO: `/v3/projects/00cb78260a5046b9a1052aa0180e57ce/users/0e89e2c76b95444ebec992a430b181bc/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:03.531258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32dbcb-d49d-476f-b433-09ef255e9ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cb78260a5046b9a1052aa0180e57ce, user_id=0e89e2c76b95444ebec992a430b181bc, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:03.533965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32dbcb-d49d-476f-b433-09ef255e9ef1 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:03.640215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1425/2882] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:36:03 2022] PUT /identity/v3/projects/00cb78260a5046b9a1052aa0180e57ce/users/0e89e2c76b95444ebec992a430b181bc/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 10:36:03.651878 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5521-8220-4e23-b09b-30b45023d4d1 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:03.652162 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5521-8220-4e23-b09b-30b45023d4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:03.652486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a5521-8220-4e23-b09b-30b45023d4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:03.680842 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-123a5521-8220-4e23-b09b-30b45023d4d1 None None] MFA Rules not processed for user `0e89e2c76b95444ebec992a430b181bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:03.681957 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-123a5521-8220-4e23-b09b-30b45023d4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:03.745144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1458/2883] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:03.749555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32dbcb-d49d-476f-b433-09ef255e9ef1 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:03.808786 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:03.812374 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32dbcb-d49d-476f-b433-09ef255e9ef1 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:03.817111 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee8d10-50d8-463c-a67a-28cd6281be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:03.822313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8d10-50d8-463c-a67a-28cd6281be90 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:03.822313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8d10-50d8-463c-a67a-28cd6281be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:03.822313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8d10-50d8-463c-a67a-28cd6281be90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:03.822313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee8d10-50d8-463c-a67a-28cd6281be90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:03.822313 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee8d10-50d8-463c-a67a-28cd6281be90 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:03.933723 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1426/2884] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:36:03 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:36:03.937523 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5521-8220-4e23-b09b-30b45023d4d1 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:03.948503 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a5521-8220-4e23-b09b-30b45023d4d1 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:04.004074 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67588c-9155-4c32-9a15-73d3b19d36e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:04.005118 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67588c-9155-4c32-9a15-73d3b19d36e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:04.005548 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67588c-9155-4c32-9a15-73d3b19d36e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:04.005825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67588c-9155-4c32-9a15-73d3b19d36e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:04.006468 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67588c-9155-4c32-9a15-73d3b19d36e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:04.008436 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67588c-9155-4c32-9a15-73d3b19d36e5 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:04.128068 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1459/2885] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:36:03 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:36:04.132530 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee8d10-50d8-463c-a67a-28cd6281be90 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:04.142552 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee8d10-50d8-463c-a67a-28cd6281be90 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:04.147936 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7f505-aa05-4aaa-95a9-4dbd50e34627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:04.148879 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7f505-aa05-4aaa-95a9-4dbd50e34627 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:04.149055 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7f505-aa05-4aaa-95a9-4dbd50e34627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:04.149339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7f505-aa05-4aaa-95a9-4dbd50e34627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:04.150067 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7f505-aa05-4aaa-95a9-4dbd50e34627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:04.151821 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7f505-aa05-4aaa-95a9-4dbd50e34627 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:04.163474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1427/2886] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:36:04.167581 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67588c-9155-4c32-9a15-73d3b19d36e5 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:04.177463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67588c-9155-4c32-9a15-73d3b19d36e5 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:04.182075 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665af152-3d8d-4730-9a54-a63b51fec69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:04.182696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af152-3d8d-4730-9a54-a63b51fec69c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:04.182974 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af152-3d8d-4730-9a54-a63b51fec69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:04.183322 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af152-3d8d-4730-9a54-a63b51fec69c admin admin] PATH_INFO: `/v3/projects/2829d36e686848d58c987433ff9a868d/users/b712b2cd6da5488eb779090d71dc7275/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:04.197888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665af152-3d8d-4730-9a54-a63b51fec69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2829d36e686848d58c987433ff9a868d, user_id=b712b2cd6da5488eb779090d71dc7275, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:04.200495 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665af152-3d8d-4730-9a54-a63b51fec69c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:04.292556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1460/2887] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:36:04 2022] PUT /identity/v3/projects/2829d36e686848d58c987433ff9a868d/users/b712b2cd6da5488eb779090d71dc7275/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:04.296575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7f505-aa05-4aaa-95a9-4dbd50e34627 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:04.306566 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7f505-aa05-4aaa-95a9-4dbd50e34627 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:04.361139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a802b47e-dc7d-4207-a5c5-3f807c65cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:04.361740 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b47e-dc7d-4207-a5c5-3f807c65cdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:04.362021 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b47e-dc7d-4207-a5c5-3f807c65cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:04.362294 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b47e-dc7d-4207-a5c5-3f807c65cdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:04.362934 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802b47e-dc7d-4207-a5c5-3f807c65cdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:04.364684 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a802b47e-dc7d-4207-a5c5-3f807c65cdf0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:04.374170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1428/2888] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:36:04.378472 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665af152-3d8d-4730-9a54-a63b51fec69c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:04.389892 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665af152-3d8d-4730-9a54-a63b51fec69c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:04.394542 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:04.395945 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:04.396225 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:04.396545 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] PATH_INFO: `/v3/projects/2829d36e686848d58c987433ff9a868d/users/b712b2cd6da5488eb779090d71dc7275/roles/fe95a036fa044c4bb408b793fba6436a` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:04.398456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2829d36e686848d58c987433ff9a868d, user_id=b712b2cd6da5488eb779090d71dc7275, role_id=fe95a036fa044c4bb408b793fba6436a)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:04.401153 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:04.411486 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1461/2889] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:36:04 2022] PUT /identity/v3/projects/2829d36e686848d58c987433ff9a868d/users/b712b2cd6da5488eb779090d71dc7275/roles/fe95a036fa044c4bb408b793fba6436a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:04.421722 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3663e3-724f-497a-91c5-e9760056e687 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:04.422008 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3663e3-724f-497a-91c5-e9760056e687 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:04.422285 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3663e3-724f-497a-91c5-e9760056e687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:04.449825 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-4c3663e3-724f-497a-91c5-e9760056e687 None None] MFA Rules not processed for user `b712b2cd6da5488eb779090d71dc7275`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:04.451042 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4c3663e3-724f-497a-91c5-e9760056e687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:04.518054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1429/2890] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:04.529970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:04.531780 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:04.541624 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:04.589132 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0cace-133d-438a-bd23-0a441dfeb04c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:04.592930 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3aa53-0a29-446b-a119-e4546f3c8611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:04.593526 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3aa53-0a29-446b-a119-e4546f3c8611 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:04.593804 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3aa53-0a29-446b-a119-e4546f3c8611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:04.594076 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3aa53-0a29-446b-a119-e4546f3c8611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:04.650288 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3aa53-0a29-446b-a119-e4546f3c8611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:04.651709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3aa53-0a29-446b-a119-e4546f3c8611 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:04.660247 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1462/2891] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:06.574087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3663e3-724f-497a-91c5-e9760056e687 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:06.575523 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-4c3663e3-724f-497a-91c5-e9760056e687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:06.588383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3663e3-724f-497a-91c5-e9760056e687 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:06.591894 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0150-eb39-4ad8-9ff8-41d5b944ebf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:06.592486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0150-eb39-4ad8-9ff8-41d5b944ebf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:06.592763 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0150-eb39-4ad8-9ff8-41d5b944ebf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:06.593033 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0150-eb39-4ad8-9ff8-41d5b944ebf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:06.641002 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:06.649988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a0150-eb39-4ad8-9ff8-41d5b944ebf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:06.651436 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a0150-eb39-4ad8-9ff8-41d5b944ebf1 service cinder] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:06.660092 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1430/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:08.097950 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3aa53-0a29-446b-a119-e4546f3c8611 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:08.106850 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3aa53-0a29-446b-a119-e4546f3c8611 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:08.110602 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424c74d-9a8b-4f8b-9e73-78ec7eb724d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:08.111200 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424c74d-9a8b-4f8b-9e73-78ec7eb724d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:08.111482 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424c74d-9a8b-4f8b-9e73-78ec7eb724d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:08.111759 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424c74d-9a8b-4f8b-9e73-78ec7eb724d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:08.121378 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424c74d-9a8b-4f8b-9e73-78ec7eb724d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:08.122822 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424c74d-9a8b-4f8b-9e73-78ec7eb724d5 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:08.133232 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1463/2893] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:12.605596 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0150-eb39-4ad8-9ff8-41d5b944ebf1 service cinder] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:12.666713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0150-eb39-4ad8-9ff8-41d5b944ebf1 service cinder] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:12.671189 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:12.671809 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:12.672087 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:12.672390 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] PATH_INFO: `/v3/users/923ffd6f06354d4485171b28965b6cc7` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:12.673501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923ffd6f06354d4485171b28965b6cc7)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:12.675424 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:12.845595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923ffd6f06354d4485171b28965b6cc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:12.853043 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923ffd6f06354d4485171b28965b6cc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:12.910484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923ffd6f06354d4485171b28965b6cc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:12.922727 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923ffd6f06354d4485171b28965b6cc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:12.923375 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923ffd6f06354d4485171b28965b6cc7'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:12.929559 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1431/2894] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:36:12 2022] DELETE /identity/v3/users/923ffd6f06354d4485171b28965b6cc7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:12.934243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7f20-c2ed-4589-86c7-8fb39df60c7d None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:12.934704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7f20-c2ed-4589-86c7-8fb39df60c7d None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:12.934845 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7f20-c2ed-4589-86c7-8fb39df60c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:12.954776 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-a94e7f20-c2ed-4589-86c7-8fb39df60c7d None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:12.955980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a94e7f20-c2ed-4589-86c7-8fb39df60c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:13.015724 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1464/2895] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:13.025474 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:13.026862 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:13.085047 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca1136-4c93-471b-b983-d7243abbdbf0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:13.088743 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a8de9-8b29-452b-a3b9-7dc6717ad79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:13.089340 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8de9-8b29-452b-a3b9-7dc6717ad79c service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:13.089618 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8de9-8b29-452b-a3b9-7dc6717ad79c service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:13.089888 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a8de9-8b29-452b-a3b9-7dc6717ad79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:13.098741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a8de9-8b29-452b-a3b9-7dc6717ad79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:13.100501 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a8de9-8b29-452b-a3b9-7dc6717ad79c service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:13.109674 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1432/2896] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:13.478763 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e7f20-c2ed-4589-86c7-8fb39df60c7d None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:13.480192 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a94e7f20-c2ed-4589-86c7-8fb39df60c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:13.497997 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e7f20-c2ed-4589-86c7-8fb39df60c7d None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:13.505241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:13.505241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:13.505241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:13.505241 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] PATH_INFO: `/v3/projects/196a333f45e04cba843d069dfc8aea8f` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:13.506281 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=196a333f45e04cba843d069dfc8aea8f)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:13.508246 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:13.587353 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:13.590910 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '196a333f45e04cba843d069dfc8aea8f', 'request_id': 'req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:13.596971 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '196a333f45e04cba843d069dfc8aea8f', 'request_id': 'req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:13.602968 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '196a333f45e04cba843d069dfc8aea8f', 'request_id': 'req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:13.665012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] The token cache is being invalidate because project 196a333f45e04cba843d069dfc8aea8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:36:13.665280 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:13.666372 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:13.667889 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1465/2897] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:36:13 2022] DELETE /identity/v3/projects/196a333f45e04cba843d069dfc8aea8f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:13.671899 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a8de9-8b29-452b-a3b9-7dc6717ad79c service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:13.682215 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a8de9-8b29-452b-a3b9-7dc6717ad79c service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:13.690897 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:13.737078 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:13.737698 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:13.737978 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:13.738251 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] PATH_INFO: `/v3/users/0e89e2c76b95444ebec992a430b181bc` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:13.739359 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e89e2c76b95444ebec992a430b181bc)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:13.741452 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:13.933526 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e89e2c76b95444ebec992a430b181bc'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:13.940164 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e89e2c76b95444ebec992a430b181bc'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.023085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e89e2c76b95444ebec992a430b181bc'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.035290 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e89e2c76b95444ebec992a430b181bc'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.036555 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e89e2c76b95444ebec992a430b181bc'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.042459 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1433/2898] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:36:13 2022] DELETE /identity/v3/users/0e89e2c76b95444ebec992a430b181bc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:14.453640 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:14.455129 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:14.469797 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0082880-332c-43bc-8ed7-3e70bfd5ac0a admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:14.528582 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:14.529213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:14.529493 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:14.529766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] PATH_INFO: `/v3/projects/00cb78260a5046b9a1052aa0180e57ce` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:14.530875 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cb78260a5046b9a1052aa0180e57ce)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:14.532831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:14.629607 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cb78260a5046b9a1052aa0180e57ce', 'request_id': 'req-02a5c4c5-1b51-4afe-ab78-f521f830756f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.636965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cb78260a5046b9a1052aa0180e57ce', 'request_id': 'req-02a5c4c5-1b51-4afe-ab78-f521f830756f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.642583 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cb78260a5046b9a1052aa0180e57ce', 'request_id': 'req-02a5c4c5-1b51-4afe-ab78-f521f830756f'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.736906 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] The token cache is being invalidate because project 00cb78260a5046b9a1052aa0180e57ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:36:14.737121 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.737739 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:14.739243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1466/2899] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:36:14 2022] DELETE /identity/v3/projects/00cb78260a5046b9a1052aa0180e57ce => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:14.743795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:14.745293 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:14.758490 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c7fd5-ed4c-42b9-941e-9b829453e520 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:14.813823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:14.814446 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:14.814730 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:14.815007 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] PATH_INFO: `/v3/users/b712b2cd6da5488eb779090d71dc7275` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:14.816121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b712b2cd6da5488eb779090d71dc7275)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:14.818792 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:15.035579 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:15.044989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b712b2cd6da5488eb779090d71dc7275'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.051589 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b712b2cd6da5488eb779090d71dc7275'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.139106 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b712b2cd6da5488eb779090d71dc7275'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.151696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b712b2cd6da5488eb779090d71dc7275'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.152371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-8e21d4fd-6cd2-4fe8-a309-bf31af1ca454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b712b2cd6da5488eb779090d71dc7275'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.158209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1434/2900] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:36:14 2022] DELETE /identity/v3/users/b712b2cd6da5488eb779090d71dc7275 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:15.550613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:15.552144 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:15.565079 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5c4c5-1b51-4afe-ab78-f521f830756f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:15.622831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:15.623463 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:15.623745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:15.624022 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] PATH_INFO: `/v3/projects/2829d36e686848d58c987433ff9a868d` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:15.625242 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2829d36e686848d58c987433ff9a868d)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:15.627142 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:15.629349 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:15.756352 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2829d36e686848d58c987433ff9a868d', 'request_id': 'req-ec9075d2-92ea-48b7-85be-b0ec64548e30'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.762475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2829d36e686848d58c987433ff9a868d', 'request_id': 'req-ec9075d2-92ea-48b7-85be-b0ec64548e30'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.770456 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2829d36e686848d58c987433ff9a868d', 'request_id': 'req-ec9075d2-92ea-48b7-85be-b0ec64548e30'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.858605 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] The token cache is being invalidate because project 2829d36e686848d58c987433ff9a868d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:36:15.858901 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.859524 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-ec9075d2-92ea-48b7-85be-b0ec64548e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:15.861048 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1467/2901] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:36:15 2022] DELETE /identity/v3/projects/2829d36e686848d58c987433ff9a868d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:15.865793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba712a7-ed29-452c-a677-ef0da6408524 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:15.866265 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba712a7-ed29-452c-a677-ef0da6408524 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:15.866370 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba712a7-ed29-452c-a677-ef0da6408524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:15.886082 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-7ba712a7-ed29-452c-a677-ef0da6408524 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:15.887275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-7ba712a7-ed29-452c-a677-ef0da6408524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:15.944687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1435/2902] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:15.953868 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737de5-2efd-46a6-89de-343923f8ae98 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:15.954156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737de5-2efd-46a6-89de-343923f8ae98 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:15.954434 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737de5-2efd-46a6-89de-343923f8ae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:15.974943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f6737de5-2efd-46a6-89de-343923f8ae98 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:15.976138 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f6737de5-2efd-46a6-89de-343923f8ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:15.983883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1468/2903] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:15.987965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba712a7-ed29-452c-a677-ef0da6408524 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:15.998182 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba712a7-ed29-452c-a677-ef0da6408524 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:16.002694 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:16.003912 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:16.004202 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:16.004505 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:16.005959 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:36:16.006256 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:16.007877 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:16.019174 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1436/2904] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 10:36:16.023561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737de5-2efd-46a6-89de-343923f8ae98 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:16.032579 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737de5-2efd-46a6-89de-343923f8ae98 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:16.037347 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04b6d0-69e5-45a3-9c03-1fb8f4c44dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:16.037943 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b6d0-69e5-45a3-9c03-1fb8f4c44dab admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:16.038224 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b6d0-69e5-45a3-9c03-1fb8f4c44dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:16.038496 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04b6d0-69e5-45a3-9c03-1fb8f4c44dab admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:16.039141 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04b6d0-69e5-45a3-9c03-1fb8f4c44dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:16.041081 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04b6d0-69e5-45a3-9c03-1fb8f4c44dab admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:16.146447 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1469/2905] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:36:16 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 10:36:16.150687 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:16.160509 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8af4-8ca9-4cef-9a18-310cb0a8abfb admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:16.216567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1a6ea-78dc-4d1f-8918-f2c8590572bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:16.217169 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a6ea-78dc-4d1f-8918-f2c8590572bf admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:16.217562 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a6ea-78dc-4d1f-8918-f2c8590572bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:16.217778 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a6ea-78dc-4d1f-8918-f2c8590572bf admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:16.218406 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1a6ea-78dc-4d1f-8918-f2c8590572bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:16.220343 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1a6ea-78dc-4d1f-8918-f2c8590572bf admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:16.297729 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1437/2906] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:36:16 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:36:16.304862 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04b6d0-69e5-45a3-9c03-1fb8f4c44dab admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:16.312866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04b6d0-69e5-45a3-9c03-1fb8f4c44dab admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:16.317550 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249ca2d-f571-4ba8-a3a1-b36a2ddbfe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:16.318792 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249ca2d-f571-4ba8-a3a1-b36a2ddbfe9c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:16.319139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249ca2d-f571-4ba8-a3a1-b36a2ddbfe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:16.319501 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249ca2d-f571-4ba8-a3a1-b36a2ddbfe9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:16.320070 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249ca2d-f571-4ba8-a3a1-b36a2ddbfe9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:16.321700 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249ca2d-f571-4ba8-a3a1-b36a2ddbfe9c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:16.331952 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1470/2907] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:36:16.336558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1a6ea-78dc-4d1f-8918-f2c8590572bf admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:16.346556 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1a6ea-78dc-4d1f-8918-f2c8590572bf admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:16.351795 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd17c4a-d139-4822-a2fe-bdc5b5148a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:16.352434 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd17c4a-d139-4822-a2fe-bdc5b5148a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:16.352712 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd17c4a-d139-4822-a2fe-bdc5b5148a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:16.352984 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd17c4a-d139-4822-a2fe-bdc5b5148a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:16.353673 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd17c4a-d139-4822-a2fe-bdc5b5148a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:16.355275 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd17c4a-d139-4822-a2fe-bdc5b5148a49 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:16.366873 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1438/2908] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:36:16.371038 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249ca2d-f571-4ba8-a3a1-b36a2ddbfe9c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:16.381196 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249ca2d-f571-4ba8-a3a1-b36a2ddbfe9c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:16.385772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:16.386408 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:16.386686 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:16.386958 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] PATH_INFO: `/v3/projects/fb3691f98bf44559bfe18bfa23b46ca8/users/35760ebed15442d2901a19c45ad110e3/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:16.401251 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3691f98bf44559bfe18bfa23b46ca8, user_id=35760ebed15442d2901a19c45ad110e3, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:16.403883 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:16.475410 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1471/2909] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:36:16 2022] PUT /identity/v3/projects/fb3691f98bf44559bfe18bfa23b46ca8/users/35760ebed15442d2901a19c45ad110e3/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:16.485767 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c3953-7f68-4984-90cc-ea5b810ca908 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:16.486057 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c3953-7f68-4984-90cc-ea5b810ca908 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:16.486330 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c3953-7f68-4984-90cc-ea5b810ca908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:16.514711 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-ec4c3953-7f68-4984-90cc-ea5b810ca908 None None] MFA Rules not processed for user `35760ebed15442d2901a19c45ad110e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:16.515914 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ec4c3953-7f68-4984-90cc-ea5b810ca908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:16.521510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:16.581022 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1439/2910] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:16.592839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:16.594750 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:16.652870 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba675c-d56b-4af6-abb5-bbcaef70c6ea admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:16.656491 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:16.657088 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:16.657364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:16.657635 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:16.666101 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:16.667516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:16.676345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1472/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:26.639713 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=24 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:26.672116 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:32.725622 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c3953-7f68-4984-90cc-ea5b810ca908 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:32.727129 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ec4c3953-7f68-4984-90cc-ea5b810ca908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:32.785346 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c3953-7f68-4984-90cc-ea5b810ca908 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:32.789595 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:32.790401 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:32.790701 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:32.791052 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:32.793143 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:32.803519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:32.805016 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:32.813264 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1440/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:42.809639 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=26 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:47.524148 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:47.526112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:47.620275 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbff66-1d13-4f1e-a296-fe1037841296 service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:47.626498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:47.627117 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:47.627402 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:47.627678 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:47.629980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:47.643181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:47.644816 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:47.656172 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1473/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:49.593468 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:49.658561 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355c20-6f6b-429b-a6ea-e055170da874 service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:49.662951 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:49.663572 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:49.663848 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:49.664119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] PATH_INFO: `/v3/users/35760ebed15442d2901a19c45ad110e3` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:49.665286 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35760ebed15442d2901a19c45ad110e3)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:49.667412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:49.824976 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:49.837388 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba125-6486-4dfd-90f1-9dc7ce80d186 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:49.843549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400ba62-fc1a-49f6-a610-c3ec847c8739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:49.844228 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ba62-fc1a-49f6-a610-c3ec847c8739 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:49.844412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35760ebed15442d2901a19c45ad110e3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:49.844672 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ba62-fc1a-49f6-a610-c3ec847c8739 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:49.845019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ba62-fc1a-49f6-a610-c3ec847c8739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:49.846978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-e400ba62-fc1a-49f6-a610-c3ec847c8739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:49.851496 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35760ebed15442d2901a19c45ad110e3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:49.860252 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400ba62-fc1a-49f6-a610-c3ec847c8739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:49.861857 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400ba62-fc1a-49f6-a610-c3ec847c8739 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:49.872869 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1474/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:49.939026 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35760ebed15442d2901a19c45ad110e3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:49.951913 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35760ebed15442d2901a19c45ad110e3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:49.952592 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35760ebed15442d2901a19c45ad110e3'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:49.958504 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1441/2915] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:36:49 2022] DELETE /identity/v3/users/35760ebed15442d2901a19c45ad110e3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:49.962973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e1b22-473a-4b26-bd23-ab566397683e None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:49.963282 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e1b22-473a-4b26-bd23-ab566397683e None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:49.963537 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e1b22-473a-4b26-bd23-ab566397683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:49.982846 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-832e1b22-473a-4b26-bd23-ab566397683e None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:49.984046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-832e1b22-473a-4b26-bd23-ab566397683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:50.044067 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1475/2916] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:50.054564 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:50.055972 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:50.125522 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767b43e-9590-4ed6-901b-274b42805ae5 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:50.129754 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6f23b-ae95-48d0-963c-54549431a8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:50.130553 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f23b-ae95-48d0-963c-54549431a8fa service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:50.130840 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f23b-ae95-48d0-963c-54549431a8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:50.131121 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6f23b-ae95-48d0-963c-54549431a8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:50.141857 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6f23b-ae95-48d0-963c-54549431a8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:50.143362 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6f23b-ae95-48d0-963c-54549431a8fa service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:50.153996 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1442/2917] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:50.593115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e1b22-473a-4b26-bd23-ab566397683e None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:50.595771 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-832e1b22-473a-4b26-bd23-ab566397683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:50.607446 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e1b22-473a-4b26-bd23-ab566397683e None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:50.618179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:50.618844 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:50.619109 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:50.619413 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] PATH_INFO: `/v3/projects/fb3691f98bf44559bfe18bfa23b46ca8` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:50.620743 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3691f98bf44559bfe18bfa23b46ca8)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:50.622876 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:50.728112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3691f98bf44559bfe18bfa23b46ca8', 'request_id': 'req-121de590-07a2-4851-a644-ada76e3ce365'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:50.734704 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3691f98bf44559bfe18bfa23b46ca8', 'request_id': 'req-121de590-07a2-4851-a644-ada76e3ce365'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:50.740259 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3691f98bf44559bfe18bfa23b46ca8', 'request_id': 'req-121de590-07a2-4851-a644-ada76e3ce365'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:50.743766 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:50.829195 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] The token cache is being invalidate because project fb3691f98bf44559bfe18bfa23b46ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:36:50.829813 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:50.830139 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-121de590-07a2-4851-a644-ada76e3ce365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:36:50.831702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1476/2918] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:36:50 2022] DELETE /identity/v3/projects/fb3691f98bf44559bfe18bfa23b46ca8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:50.836741 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006848-1968-4edb-8c9d-858a2798500b None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:50.837567 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006848-1968-4edb-8c9d-858a2798500b None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:50.837845 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de006848-1968-4edb-8c9d-858a2798500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:50.857935 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-de006848-1968-4edb-8c9d-858a2798500b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:50.859161 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-de006848-1968-4edb-8c9d-858a2798500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:50.875842 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:50.918573 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1443/2919] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:36:50.927744 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1fcd0-af49-467c-95f2-c89efaf76a49 None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:50.928033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1fcd0-af49-467c-95f2-c89efaf76a49 None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:50.928329 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1fcd0-af49-467c-95f2-c89efaf76a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:50.949599 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-f4b1fcd0-af49-467c-95f2-c89efaf76a49 None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:50.950136 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-f4b1fcd0-af49-467c-95f2-c89efaf76a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:50.959598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1477/2920] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:50.963932 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de006848-1968-4edb-8c9d-858a2798500b None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:50.973484 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de006848-1968-4edb-8c9d-858a2798500b None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:50.978105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:50.978705 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:50.978989 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:50.979258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] PATH_INFO: `/v3/domains` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:50.979907 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 10:36:50.980209 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:50.981909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:50.993291 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1444/2921] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 28 10:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 10:36:50.997516 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1fcd0-af49-467c-95f2-c89efaf76a49 None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:51.007575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1fcd0-af49-467c-95f2-c89efaf76a49 None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:51.012204 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c055600-d24e-4bbf-9d33-6ac6917f224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:51.012831 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c055600-d24e-4bbf-9d33-6ac6917f224e admin admin] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:51.013112 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c055600-d24e-4bbf-9d33-6ac6917f224e admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:51.013385 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c055600-d24e-4bbf-9d33-6ac6917f224e admin admin] PATH_INFO: `/v3/projects` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:51.014019 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c055600-d24e-4bbf-9d33-6ac6917f224e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:51.016764 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c055600-d24e-4bbf-9d33-6ac6917f224e admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:51.090745 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1478/2922] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 28 10:36:50 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:36:51.093954 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:51.104338 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4e7a-ec25-4494-a550-4f790b0e3efd admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:51.162230 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bff3-86f1-443f-918d-c4aee619a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:51.162832 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bff3-86f1-443f-918d-c4aee619a6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:51.163110 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bff3-86f1-443f-918d-c4aee619a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:51.163380 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bff3-86f1-443f-918d-c4aee619a6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:51.164015 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2bff3-86f1-443f-918d-c4aee619a6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:51.165990 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2bff3-86f1-443f-918d-c4aee619a6a0 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:51.286153 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1445/2923] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 28 10:36:51 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 10:36:51.290278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c055600-d24e-4bbf-9d33-6ac6917f224e admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:51.300823 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c055600-d24e-4bbf-9d33-6ac6917f224e admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:51.306649 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e720fcd-35e8-4439-964d-b6171c8ecf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:51.307263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720fcd-35e8-4439-964d-b6171c8ecf6c admin admin] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:51.307547 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720fcd-35e8-4439-964d-b6171c8ecf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:51.307825 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720fcd-35e8-4439-964d-b6171c8ecf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:51.308504 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720fcd-35e8-4439-964d-b6171c8ecf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:51.310181 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720fcd-35e8-4439-964d-b6171c8ecf6c admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:51.320897 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1479/2924] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 10:36:51.324887 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bff3-86f1-443f-918d-c4aee619a6a0 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:51.335766 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bff3-86f1-443f-918d-c4aee619a6a0 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:51.340383 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed40544-67fe-44a7-9b79-1b224808693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:51.340977 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed40544-67fe-44a7-9b79-1b224808693e admin admin] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:51.341258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed40544-67fe-44a7-9b79-1b224808693e admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:51.341532 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed40544-67fe-44a7-9b79-1b224808693e admin admin] PATH_INFO: `/v3/roles` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:51.342177 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed40544-67fe-44a7-9b79-1b224808693e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:51.344120 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed40544-67fe-44a7-9b79-1b224808693e admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:51.354689 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1446/2925] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 28 10:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 10:36:51.359452 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e720fcd-35e8-4439-964d-b6171c8ecf6c admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:51.369366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e720fcd-35e8-4439-964d-b6171c8ecf6c admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:51.374498 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:51.375143 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:51.375425 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:51.375702 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] PATH_INFO: `/v3/projects/c0c961d0c3a94af99d743f25a7e0c570/users/048eaddda3c64153abef99c80cbc19dd/roles/983dd1ee6dee498dac7c66c3c5a68bc7` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:51.391270 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c961d0c3a94af99d743f25a7e0c570, user_id=048eaddda3c64153abef99c80cbc19dd, role_id=983dd1ee6dee498dac7c66c3c5a68bc7)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:51.393966 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:51.492962 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1480/2926] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 28 10:36:51 2022] PUT /identity/v3/projects/c0c961d0c3a94af99d743f25a7e0c570/users/048eaddda3c64153abef99c80cbc19dd/roles/983dd1ee6dee498dac7c66c3c5a68bc7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:36:51.504510 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca4774-9a98-4c1c-95a0-a20523cc72dc None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:51.504818 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca4774-9a98-4c1c-95a0-a20523cc72dc None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:51.505089 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca4774-9a98-4c1c-95a0-a20523cc72dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:51.532823 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-9cca4774-9a98-4c1c-95a0-a20523cc72dc None None] MFA Rules not processed for user `048eaddda3c64153abef99c80cbc19dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:51.534079 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-9cca4774-9a98-4c1c-95a0-a20523cc72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:51.596608 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1447/2927] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:51.607377 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:51.609649 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:51.669948 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b4de-99cc-46a1-bd5e-f731317f7a16 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:51.685092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b03cdf17a244cf094a7ce93775da22c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:51.686008 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:51.687004 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:51.687255 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:51.696393 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:51.697815 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:51.707460 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1481/2928] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:53.432227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f65d9-9251-4c00-9382-fcb747515431 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:53.432801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f65d9-9251-4c00-9382-fcb747515431 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:53.432801 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f65d9-9251-4c00-9382-fcb747515431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:53.452400 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-759f65d9-9251-4c00-9382-fcb747515431 None None] MFA Rules not processed for user `048eaddda3c64153abef99c80cbc19dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:36:53.453806 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-759f65d9-9251-4c00-9382-fcb747515431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:53.460699 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1448/2929] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:36:54.031314 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:54.033001 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:54.139852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53c820-7817-4531-a9a6-02fe70f8792a service cinder] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:54.144998 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:54.146102 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:54.150866 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:54.151211 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:54.153413 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:54.170632 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:54.172642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:54.183588 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1482/2930] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:36:56.842065 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f65d9-9251-4c00-9382-fcb747515431 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:36:56.854431 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f65d9-9251-4c00-9382-fcb747515431 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:36:56.859519 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:36:56.860105 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:36:56.860414 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:36:56.860691 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:36:56.862426 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:36:56.874163 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:36:56.876085 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:36:56.880852 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:36:56.887360 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1449/2931] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:36:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:37:00.556652 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:00.558185 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:00.588012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:37:00.624885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efcf15-6fce-4cc7-a1fa-d03a16cfa290 service placement] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:00.629696 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:00.630325 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:00.630613 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:00.630888 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] PATH_INFO: `/v3/users/7d6d9713a927415d8618bacd76622280` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:00.632000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6d9713a927415d8618bacd76622280)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:00.634021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:00.820898 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6d9713a927415d8618bacd76622280'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:00.828748 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6d9713a927415d8618bacd76622280'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:00.841263 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6d9713a927415d8618bacd76622280'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:00.925511 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6d9713a927415d8618bacd76622280'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:00.926331 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6d9713a927415d8618bacd76622280'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:00.932566 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1483/2932] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:37:00 2022] DELETE /identity/v3/users/7d6d9713a927415d8618bacd76622280 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:37:01.426412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:01.437641 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500064f-ced3-43f9-a93c-f3657ecce722 service placement] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:01.495157 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:01.495784 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:01.496066 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:01.496371 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] PATH_INFO: `/v3/projects/31268c8c8c0f40fcbe1f5633975b2609` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:01.497524 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31268c8c8c0f40fcbe1f5633975b2609)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:01.500139 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:01.618420 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31268c8c8c0f40fcbe1f5633975b2609', 'request_id': 'req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:01.692811 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31268c8c8c0f40fcbe1f5633975b2609', 'request_id': 'req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:01.699804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31268c8c8c0f40fcbe1f5633975b2609', 'request_id': 'req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:01.710659 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] The token cache is being invalidate because project 31268c8c8c0f40fcbe1f5633975b2609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:37:01.710944 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:01.711575 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:01.713091 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1450/2933] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:37:01 2022] DELETE /identity/v3/projects/31268c8c8c0f40fcbe1f5633975b2609 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:37:01.717033 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:01.718561 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:01.731414 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938999af-68f9-477f-bfd7-76f56674e749 admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:01.788399 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:01.789021 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:01.789556 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:01.789833 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] PATH_INFO: `/v3/users/c79f6473093f48b98c91fbcaa320afa3` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:01.791012 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79f6473093f48b98c91fbcaa320afa3)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:01.792973 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:01.933321 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:37:01.934827 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79f6473093f48b98c91fbcaa320afa3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:01.942513 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79f6473093f48b98c91fbcaa320afa3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:01.954311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79f6473093f48b98c91fbcaa320afa3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:02.001179 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79f6473093f48b98c91fbcaa320afa3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:02.001795 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79f6473093f48b98c91fbcaa320afa3'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:02.008092 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1484/2934] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:37:01 2022] DELETE /identity/v3/users/c79f6473093f48b98c91fbcaa320afa3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:37:02.236997 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:02.238584 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:02.253064 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aedf9-2d62-4dfb-bda0-52812cc0af93 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:02.320170 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:02.321571 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:02.322045 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:02.322576 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] PATH_INFO: `/v3/projects/d11cb7a48f894deb9481e7c5a713946c` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:02.324527 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11cb7a48f894deb9481e7c5a713946c)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:02.326521 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:02.424119 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:37:02.436444 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11cb7a48f894deb9481e7c5a713946c', 'request_id': 'req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:02.509930 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11cb7a48f894deb9481e7c5a713946c', 'request_id': 'req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:02.516413 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11cb7a48f894deb9481e7c5a713946c', 'request_id': 'req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:02.527195 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] The token cache is being invalidate because project d11cb7a48f894deb9481e7c5a713946c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:37:02.527696 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:02.528804 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-49c87bb4-b301-4ecd-8fb4-ec6b73d03ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:02.530350 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1451/2935] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:37:02 2022] DELETE /identity/v3/projects/d11cb7a48f894deb9481e7c5a713946c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:37:05.057852 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:05.059303 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:05.136885 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dda93-5748-45a3-ab76-cc5a5ffdc87f admin admin] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:05.204802 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e8ce142e0c944b49053bd2a44ce4853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:05.205411 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:05.205694 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:05.205970 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:05.207688 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:05.220540 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:05.223572 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:05.232793 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1485/2936] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:37:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:37:11.069558 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aae3f-f57e-4ab8-8f49-7be0a5665cad None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:11.070145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aae3f-f57e-4ab8-8f49-7be0a5665cad None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:11.070145 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aae3f-f57e-4ab8-8f49-7be0a5665cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:11.118800 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-b09aae3f-f57e-4ab8-8f49-7be0a5665cad None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:37:11.120012 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-b09aae3f-f57e-4ab8-8f49-7be0a5665cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:11.186354 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1452/2937] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:37:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:37:11.307514 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:11.308965 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:11.360445 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:37:11.397345 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675530b-9f64-48bd-8cb5-cf5732d63f06 service nova] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:11.402311 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f241076-6f8d-40a8-a8e6-c317e754d43c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:11.402913 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241076-6f8d-40a8-a8e6-c317e754d43c service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:11.406877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241076-6f8d-40a8-a8e6-c317e754d43c service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:11.406877 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241076-6f8d-40a8-a8e6-c317e754d43c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:11.412574 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f241076-6f8d-40a8-a8e6-c317e754d43c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:11.414269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f241076-6f8d-40a8-a8e6-c317e754d43c service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:11.422978 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1486/2938] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:37:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:37:12.161764 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bd1c-e1b3-4614-9cb4-ffa66ccdf822 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:12.162210 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bd1c-e1b3-4614-9cb4-ffa66ccdf822 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:12.162366 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390bd1c-e1b3-4614-9cb4-ffa66ccdf822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:12.181061 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-d390bd1c-e1b3-4614-9cb4-ffa66ccdf822 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:37:12.182240 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-d390bd1c-e1b3-4614-9cb4-ffa66ccdf822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:12.189953 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1453/2939] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:37:12.201839 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f241076-6f8d-40a8-a8e6-c317e754d43c service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:12.213099 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f241076-6f8d-40a8-a8e6-c317e754d43c service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:12.218115 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f4b5d-ba28-4835-af26-b3f36c55f72a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:12.218709 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f4b5d-ba28-4835-af26-b3f36c55f72a service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:12.218992 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f4b5d-ba28-4835-af26-b3f36c55f72a service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:12.219267 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f4b5d-ba28-4835-af26-b3f36c55f72a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:12.227156 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f4b5d-ba28-4835-af26-b3f36c55f72a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:12.228772 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f4b5d-ba28-4835-af26-b3f36c55f72a service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:12.236811 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1487/2940] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:37:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:37:12.884947 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a4db4-993f-4b91-9ece-975650e0be47 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:12.885257 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a4db4-993f-4b91-9ece-975650e0be47 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:12.885634 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a4db4-993f-4b91-9ece-975650e0be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:12.904704 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-500a4db4-993f-4b91-9ece-975650e0be47 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:37:12.906661 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-500a4db4-993f-4b91-9ece-975650e0be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:12.913700 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1454/2941] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 28 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:37:12.926575 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f4b5d-ba28-4835-af26-b3f36c55f72a service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:12.937366 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f4b5d-ba28-4835-af26-b3f36c55f72a service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:12.942389 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ae1f-3f16-4c78-a654-131d922f9a5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:12.942980 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ae1f-3f16-4c78-a654-131d922f9a5f service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:12.943261 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ae1f-3f16-4c78-a654-131d922f9a5f service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:12.943534 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7ae1f-3f16-4c78-a654-131d922f9a5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:12.951494 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7ae1f-3f16-4c78-a654-131d922f9a5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:12.953135 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7ae1f-3f16-4c78-a654-131d922f9a5f service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:12.961243 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1488/2942] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:37:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 10:37:13.540772 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f628229-a461-4885-b8a4-82d31976c393 None None] REQUEST_METHOD: `POST` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:13.541227 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f628229-a461-4885-b8a4-82d31976c393 None None] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:13.541339 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f628229-a461-4885-b8a4-82d31976c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:13.559585 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.auth.core [None req-5f628229-a461-4885-b8a4-82d31976c393 None None] MFA Rules not processed for user `b3c1e3989f3242b6a9626272dea1d7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:37:13.560794 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5f628229-a461-4885-b8a4-82d31976c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:13.568358 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1455/2943] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 28 10:37:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 10:37:13.580914 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ae1f-3f16-4c78-a654-131d922f9a5f service swift] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:13.591317 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7ae1f-3f16-4c78-a654-131d922f9a5f service swift] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:13.596475 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c86c95-d780-4b3d-8712-c5ea8113446a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00dd24daa5374b85adbca9b16b807537', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:13.597093 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86c95-d780-4b3d-8712-c5ea8113446a service swift] REQUEST_METHOD: `GET` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:13.597371 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86c95-d780-4b3d-8712-c5ea8113446a service swift] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:13.597642 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c86c95-d780-4b3d-8712-c5ea8113446a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:13.605384 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c86c95-d780-4b3d-8712-c5ea8113446a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:13.606940 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c86c95-d780-4b3d-8712-c5ea8113446a service swift] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:13.615046 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1489/2944] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 28 10:37:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 10:37:16.398109 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f628229-a461-4885-b8a4-82d31976c393 None None] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:16.399624 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-5f628229-a461-4885-b8a4-82d31976c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:16.465231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f628229-a461-4885-b8a4-82d31976c393 None None] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:16.470412 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:16.471037 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:16.471317 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:16.471628 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] PATH_INFO: `/v3/users/048eaddda3c64153abef99c80cbc19dd` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:16.472793 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048eaddda3c64153abef99c80cbc19dd)` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:16.476881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:16.487531 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:37:16.619255 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048eaddda3c64153abef99c80cbc19dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:16.626427 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048eaddda3c64153abef99c80cbc19dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:16.697881 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048eaddda3c64153abef99c80cbc19dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:16.710542 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048eaddda3c64153abef99c80cbc19dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:16.713486 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.notifications [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048eaddda3c64153abef99c80cbc19dd'} {{(pid=81597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:16.717072 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1456/2945] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 28 10:37:16 2022] DELETE /identity/v3/users/048eaddda3c64153abef99c80cbc19dd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:37:16.722205 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dd342-7849-4eaf-b9ad-dac375ce247b None None] REQUEST_METHOD: `POST` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:16.722693 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dd342-7849-4eaf-b9ad-dac375ce247b None None] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:16.722805 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dd342-7849-4eaf-b9ad-dac375ce247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:16.742095 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.auth.core [None req-320dd342-7849-4eaf-b9ad-dac375ce247b None None] MFA Rules not processed for user `41f4ecddb8d24b6f9cf0196547a5fb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81596) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 10:37:16.743316 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-320dd342-7849-4eaf-b9ad-dac375ce247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:16.801758 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1490/2946] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 28 10:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 10:37:16.811388 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:16.812803 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:16.869261 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54c971-4d6f-4ca0-a050-4483364c9d72 admin admin] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:16.872889 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '757ad5baa909451d94dd1eced0407d50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:16.873511 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:16.873787 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:16.874054 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:16.883540 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:16.885083 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:16.894995 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1457/2947] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:37:17.135219 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dd342-7849-4eaf-b9ad-dac375ce247b None None] Authenticating user token {{(pid=81596) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:37:17.136740 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.fernet_utils [None req-320dd342-7849-4eaf-b9ad-dac375ce247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81596) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:37:17.149757 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dd342-7849-4eaf-b9ad-dac375ce247b None None] Validating token access rules against request {{(pid=81596) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:37:17.154364 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f4ecddb8d24b6f9cf0196547a5fb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86f5f0c06d84427a9264fb27dee1d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81596) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:37:17.155000 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:37:17.155278 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:37:17.155549 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] PATH_INFO: `/v3/projects/c0c961d0c3a94af99d743f25a7e0c570` {{(pid=81596) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:37:17.157360 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c961d0c3a94af99d743f25a7e0c570)` {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:37:17.159269 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] RBAC: Authorization granted {{(pid=81596) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:37:17.267532 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c961d0c3a94af99d743f25a7e0c570', 'request_id': 'req-d5db0a53-066f-4307-94c8-c415b72cdf39'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:17.274152 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c961d0c3a94af99d743f25a7e0c570', 'request_id': 'req-d5db0a53-066f-4307-94c8-c415b72cdf39'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:17.280213 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c961d0c3a94af99d743f25a7e0c570', 'request_id': 'req-d5db0a53-066f-4307-94c8-c415b72cdf39'} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:17.344598 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG dbcounter [-] [81596] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81596) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:37:17.348520 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] The token cache is being invalidate because project c0c961d0c3a94af99d743f25a7e0c570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81596) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 10:37:17.348812 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:17.349458 dv-cinder-852009-4-smb devstack@keystone.service[81596]: DEBUG keystone.notifications [None req-d5db0a53-066f-4307-94c8-c415b72cdf39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81596) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 10:37:17.351007 dv-cinder-852009-4-smb devstack@keystone.service[81596]: [pid: 81596|app: 0|req: 1491/2948] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 28 10:37:17 2022] DELETE /identity/v3/projects/c0c961d0c3a94af99d743f25a7e0c570 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 10:37:26.890321 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 10:38:36.959473 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] Authenticating user token {{(pid=81597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 10:38:36.960909 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:38:37.035988 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5b670-6521-4ba4-bf97-c44d50fe540b service neutron] Validating token access rules against request {{(pid=81597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 10:38:37.095160 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8574b1-1381-4cb5-969e-c31c23dc22cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36276f9c3f840e881d15ece72a94d07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09b15978874aed9b128f6cf9006ae7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 10:38:37.095681 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8574b1-1381-4cb5-969e-c31c23dc22cf service placement] REQUEST_METHOD: `GET` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 10:38:37.095957 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8574b1-1381-4cb5-969e-c31c23dc22cf service placement] SCRIPT_NAME: `/identity` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 10:38:37.096231 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8574b1-1381-4cb5-969e-c31c23dc22cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 10:38:37.097965 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.fernet_utils [None req-ea8574b1-1381-4cb5-969e-c31c23dc22cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 10:38:37.109690 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8574b1-1381-4cb5-969e-c31c23dc22cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 10:38:37.111258 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8574b1-1381-4cb5-969e-c31c23dc22cf service placement] RBAC: Authorization granted {{(pid=81597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 10:38:37.120867 dv-cinder-852009-4-smb devstack@keystone.service[81597]: [pid: 81597|app: 0|req: 1458/2949] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 28 10:38:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 10:38:47.116750 dv-cinder-852009-4-smb devstack@keystone.service[81597]: DEBUG dbcounter [-] [81597] Writing DB stats keystone:SELECT=58 {{(pid=81597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}